AI Response Evaluator
iMerit is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you will do
- Interpret conversational context and identify what the user really wanted
- Rate and rank responses against defined quality criteria
- Compare multiple answers and explain in writing why one wins
- Verify factual claims using approved research sources
- Flag tasks that cannot be reliably assessed rather than guessing
What you bring:
- Strong critical thinking and sound judgment in ambiguous cases
- Solid research skills and attention to detail
- Excellent reading comprehension
- Self direction and the discipline to hit deadlines without supervision
Good to know
- Independent contractor engagement for the length of the project.
- Fully remote and flexible.
- You choose your hours as long as volume and deadlines are met.
- Task volume varies with project demand.
Skills
- ai
Similar roles
Customer Support Specialist
Assignr LLC·Worldwide
Come Join Our Team! We strive to provide outstanding support to our customers, and we are looking for a team member to help us out. Most of our customer support is provided via email and Intercom messenger, with some support by phone and via Zoom web conference. As a member of the Assignr support team, you will: * Respond to…
- Remote
- Full-time
Reporter
Prescott News Network·Prescott Valley, United States
DESCRIPTION We are seeking a driven Reporter to join our community-focused newsroom. This role is responsible for covering local news, developing story ideas, conducting interviews, capturing photos and video, and producing engaging content for both print and digital platforms. The ideal candidate is a strong storyteller who is passionate about local journalism, thrives in a fast-paced environment, and enjoys building…
- On-site
- Full-time
Health and Social Care Assessor (Trainee or Qualified)
KM Education Recruitment Ltd·Liverpool, United Kingdom
KM Recruitment is a specialist UK wide recruiter for the Skills & Employability sectors. We have a new opportunity for a Health and Social Care Assessor and are able to consider both qualified and unqualified Assessors! Job Title: Health and Social Care Assessor (Trainee or Qualified) Full training and support will be given to trainee candidates to achieve a recognised…
- On-site
- Full-time
- £29k–£30k / yr
Senior Partner Manager - DACH
Tellent·Germany
ABOUT THE ROLE As our Senior Partner Manager DACH, you'll own and grow Tellent's partner ecosystem across the DACH market. You'll inherit an established network of reseller and referral partners, including a group of key strategic partners with significant growth potential — and your role is to turn that foundation into a stronger, more predictable source of pipeline and revenue.…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
FT Facilities Team Member
Horizon Outdoor Hospitality·Baton Rouge, United States
FACILITIES TEAM MEMBER POSITION DESCRIPTION GENERAL PURPOSE Facility Team Members will help lead the resort to the highest standards possible by working with the General Manager and Management Company to efficiently maintain all resort facilities, including, but not limited to: landscaping, all structures (interior and exterior), restrooms, laundry rooms, recreation rooms, pool care, and RV sites. Through these efforts, Facilities…
- Full-time
Child Safety Enforcement Specialist
Openai·San Francisco, United States
About the Team OpenAI’s mission is to ensure that general-purpose artificial intelligence benefits all of humanity. We believe achieving this goal requires real-world deployment and continuous iteration based on how our products are used—and misused—in practice. The Child Safety team is responsible for detection, review, and enforcement of OpenAI’s Child Safety product policies. We leverage a balanced use of technology…
- Hybrid
- Full-time
Speech Pathologist
Proactive Health·Canberra, Australia
Renew Living is one of Canberra's allied health clinics in the Proactive Health network, and we're looking for a Speech Pathologist to join the team. You'll manage your own caseload of paediatric / adult / mixed NDIS clients, working alongside a multidisciplinary team who genuinely back each other. Every clinician here gets the room to do their best work —…
- Full-time
- Skilled Independent 189 — PR, no sponsor
Maintenance/Courtesy Patrol Team Member (PT, Year-Round)
Horizon Outdoor Hospitality·Ontario, United States
Do you enjoy working outdoors, fixing things, helping people, and seeing the results of a job well done? River Point RV Park is looking for a dependable, hands-on Part-Time Maintenance & Courtesy Patrol Worker to help keep our park clean, well-maintained, welcoming, and enjoyable for our guests. If you take pride in your work, enjoy variety in your day, are…
- Part-time
