Pay: $14 – $36/hour
Role Title: Senior AI Trainer
Role Type: Contractor, Remote
Location: Remote
micro1 is looking for experienced Senior AI Trainers to join a customer-focused project dedicated to improving the quality, reliability, and performance of AI systems through expert-level training and evaluation.
In this role, you’ll apply your generalist knowledge, analytical skills, and hands-on experience with AI products to evaluate and improve next-generation AI models. Your feedback will help shape how AI systems learn, reason, respond to users, and handle real-world scenarios.
Key Responsibilities
- Evaluate AI performance: Test AI chat and search tools under consistent, standardized conditions and assess how effectively they handle different tasks and user requests.
- Grade and annotate model responses: Follow detailed evaluation guidelines to accurately assess, rank, and annotate AI-generated responses while providing structured feedback to improve model quality.
- Develop and test prompts: Create, refine, and stress-test prompts designed to evaluate model capabilities across a broad range of scenarios, edge cases, and user intents.
- Maintain evaluation accuracy: Review completed evaluations for consistency and accuracy, identifying and correcting discrepancies between ratings and the established guidelines.
- Record training data: Use designated AI training platforms and tools to document findings and submit high-quality evaluation datasets according to project requirements and deadlines.
- Collaborate with the team: Work closely with project trainers and other contributors to clarify ambiguous cases, improve evaluation guidelines, and maintain consistency across the project.
- Participate in quality reviews: Regularly review your work and incorporate feedback to maintain high standards for AI training, evaluation, and annotation.
Required Skills & Qualifications
- Exceptional attention to detail, particularly when reviewing and evaluating AI-generated content.
- Strong written and verbal communication skills for documenting findings, collaborating with team members, and communicating project updates.
- Excellent time-management and organizational skills, with the ability to work independently in a remote environment.
- Strong analytical and problem-solving abilities, combined with a proactive approach to identifying and resolving evaluation challenges.
Preferred Qualifications
Candidates with the following experience are especially encouraged to apply:
- Previous experience with AI model training, RLHF, data labeling, or AI evaluation projects.
- Familiarity with modern AI products and tools, including prompt engineering and an understanding of common model behaviors and limitations.
- Experience creating or applying evaluation rubrics, grading AI outputs, or reviewing model responses for accuracy, usefulness, relevance, and safety.
- Background in AI training, machine-learning data preparation, large language models (LLMs), or related AI projects is strongly preferred.
About the Opportunity
This is an opportunity to contribute your professional expertise to the development of increasingly capable AI systems. By evaluating real-world model outputs and providing high-quality feedback, you’ll play a direct role in helping AI systems become more accurate, consistent, useful, and reliable.