Data Operations Lead — RLHF

About the Role

Scale AI is looking for a Data Operations Lead to manage large-scale RLHF data annotation programs for frontier AI companies. You will design annotation guidelines, build quality assurance processes, and lead distributed teams of evaluators to produce high-quality training data.

Requirements

• 5+ years of experience in data operations or data quality
• Experience with human evaluation and annotation workflows
• Strong project management and team leadership skills
• Understanding of LLM training data requirements
• Experience with data quality metrics and frameworks

Nice to Have

• Experience with RLHF or preference data collection
• Background in computational linguistics
• Familiarity with Scale AI's platform
• Experience managing globally distributed teams

Benefits

Skills

Related Jobs