Position: AI Evaluation Specialist

Type: Contract

Compensation: $22 - $70/hour

Location: Remote

Commitment: 10-40 hrs/week

Role Responsibilities

Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience. Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences. Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements. Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes. Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results. Contribute to the continuous enhancement of evaluation workflows and best practices.

Requirements

Have native English proficiency at C1 or C2 level. Possess exceptional reading comprehension and acute attention to detail. Demonstrate strong observational skills with excellent aesthetic or editorial judgment. Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios. Have excellent written and verbal communication skills.

Application Process

Easy Apply on LinkedIn Check email for next steps Participate in resume evaluation & interview stage