AI Trainer – Remote (Contract, $35‑$50/hr)

About the role

We are seeking an experienced AI Trainer to work remotely on a contract basis. You will design and refine assessment rubrics that guide AI model evaluation, ensuring high‑quality, consistent results across projects.

Key responsibilities

• Design, develop, and continuously improve comprehensive rubrics for AI training and assessment.
• Analyze task performance data and provide structured, actionable feedback for model calibration.
• Establish and document scoring methodologies that promote fairness and consistency.
• Lead calibration sessions to align evaluators and maintain rubric integrity.
• Validate assessment outputs for accuracy, reliability, and alignment with project goals.
• Oversee quality‑control processes and recommend data‑driven rubric enhancements.

Required profile

• Proven expertise in rubric design, performance analysis, and feedback structuring for complex assessment environments.
• Strong background in scoring methodology development and calibration for AI or educational projects.
• Demonstrated success in assessment validation and quality‑control processes.
• Exceptional written and verbal communication skills, capable of conveying nuanced judgments.
• Practical, hands‑on grocery‑shopping experience to inform realistic scenario assessments.

Required skills

What we offer

• Flexible remote work schedule (10‑40 hrs/week).
• Competitive hourly rate ranging from $35 to $50.
• Opportunity to shape AI assessment standards across multiple projects.