AI Evaluation Specialist – Remote

About the role

As an AI Evaluation Specialist you will help train next‑generation artificial‑intelligence systems by providing high‑quality, real‑world feedback on model outputs. No prior AI experience is required; your domain knowledge and keen eye for detail are what matter.

Key responsibilities

• Review AI‑generated content for quality, clarity, usability and overall user experience.
• Identify inconsistencies, weaknesses and improvement opportunities across diverse content types and visual experiences.
• Apply structured evaluation guidelines and deliver nuanced feedback to inform model improvements.
• Collaborate with cross‑functional teams to define and refine quality standards, scoring criteria and review processes.
• Maintain high accuracy and consistency across evaluations to ensure reliable, actionable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.
• Support the development of training data that improves AI system performance and reliability.

Required profile

• Exceptional reading comprehension and acute attention to detail.
• Strong observational skills with excellent aesthetic or editorial judgment.
• Ability to think critically and deliver consistent, high‑quality evaluations in ambiguous scenarios.
• Excellent written and verbal communication skills.
• Comfort working across various content types and evaluation guidelines.
• Strong sense of ownership, reliability and commitment to delivering high‑quality work.
• Open‑minded approach to learning and quickly adapting to new workflows.

Required skills