Senior Data Labeler

About This Opportunity

Our talent team at Get A Job.ai is representing a confidential AI safety organization based in Paris. This venture-backed company is building advanced infrastructure for enterprise AI systems and is experiencing rapid growth. They're looking for a Senior Data Labeler to build and lead their annotation operations from the ground up.

This is a hands-on leadership role where you'll establish the foundation for high-quality data labeling at scale, directly supporting model training and evaluation initiatives. You'll join during a phase of proven market demand while retaining significant equity upside.

Responsibilities

• Build and lead the data labeling team from scratch, including hiring, coaching, and performance management
• Define annotation guidelines, quality standards, and evaluation frameworks for AI model improvement
• Develop quality assurance processes, calibration sessions, and auditing systems to ensure consistency
• Partner with AI researchers and engineers to translate technical objectives into actionable labeling workflows
• Prioritize labeling projects based on business impact and research needs
• Monitor operational metrics including quality, consistency, throughput, and cost efficiency
• Lead complex AI evaluation projects including safety assessments, preference ranking, RLHF, and benchmark creation
• Analyze disagreement patterns and edge cases to refine guidelines and improve model performance
• Manage vendor relationships and ensure quality across distributed teams
• Build reporting dashboards and communicate operational insights to leadership
• Improve annotation tooling, automation, and workflow efficiency

Important note: This role involves overseeing projects that may include offensive, harmful, violent, sexual, or otherwise disturbing content. You'll be responsible for ensuring reviewers have appropriate tools, guidance, and support to perform this work safely.

What We're Looking For

Must-have skills:

• Proven experience leading data annotation or AI evaluation teams
• Strong operational and people management capabilities
• Understanding of AI model evaluation, LLM behavior, and modern annotation workflows
• Ability to design scalable processes while maintaining high quality standards
• Clear communication skills across technical and non-technical stakeholders
• Comfort working in fast-moving startup environments

Ideal background:

• Experience managing annotation programs for LLMs, generative AI, or machine learning systems
• Hands-on work with RLHF, preference data collection, safety evaluations, or benchmark creation
• Background in Trust & Safety, AI Safety, Content Moderation, or ML Operations
• Experience managing distributed or global annotation teams
• Vendor management and outsourcing operations experience

Bonus qualifications:

• Familiarity with prompt engineering and AI safety frameworks
• SQL, Python, or data analysis skills
• Experience building internal annotation platforms or workflow automation
• Background in linguistics, cognitive science, machine learning, or data operations

How We Work With You

When you apply through Get A Job.ai, one of our recruiters will conduct an initial screening to understand your background and match you with this opportunity. If there's mutual interest, we'll submit your profile to our client for consideration. You'll then proceed through their interview process, which includes a take-home exercise and final conversation with leadership.

Please do not attempt to contact the client directly – all applications must come through our recruiting team to be considered.

Location & Benefits

This role is based in Paris with a hybrid work arrangement. Relocation packages may be available for qualified candidates. The client offers competitive compensation including equity, paid time off in accordance with local regulations, comprehensive hardware and tooling, and regular team off-sites.

Applications should be submitted in English.

Equal Opportunity

Get A Job.ai is committed to inclusive recruiting practices. We welcome applications from candidates of all backgrounds and work to ensure fair evaluation throughout our process.