Safeguards Enforcement Analyst, Child Safety

Join Anthropic as a full-time Safeguards Enforcement Analyst on the Child Safety team, based remotely or in our San Francisco, New York City, or Washington, DC offices. Anthropic is building safe, reliable, and interpretable AI systems—and this role is fundamental to that mission.

The Opportunity

You will lead the operational foundation of our child safety enforcement program, overseeing the detection, review, and response systems designed to identify and prevent child sexual abuse material (CSAM) and child sexual exploitation material (CSEM) on our AI products. As the central operational leader for this critical work, you'll manage workflows, coordinate with content reviewers, and partner with engineering, policy, and legal teams to strengthen our defenses as threats evolve. Your decisions and processes directly protect children from AI-facilitated harm.

This is intensive, operational work. You will be exposed to explicit and disturbing content involving minors. Anthropic prioritizes the wellbeing of team members in this function and provides comprehensive wellness support.

Key Responsibilities

• Direct day-to-day operations of child safety content review, including task assignment, queue prioritization, escalation procedures, and SLA compliance monitoring
• Serve as the lead liaison with content review teams, managing recruitment, training, quality verification, and ongoing collaboration
• Architect enforcement workflows that grow reliably while maintaining accuracy and consistency across decisions
• Collaborate with engineering and data science to enhance automated detection systems and strengthen CSAM and CSEM enforcement tools
• Evaluate novel or contested content to inform enforcement decisions and identify policy gaps
• Build and maintain operational documentation, enforcement logic guides, and quality standards that enable consistent decisions at scale
• Monitor policy trends, emerging legal requirements, and advances in child safety technology to refine operations
• Track and communicate patterns of misuse to policy, legal, and trust & safety leaders
• Manage external compliance reporting, including coordination with organizations like the National Center for Missing & Exploited Children (NCMEC) as required by law

Qualifications

We're looking for candidates with a bachelor's degree or equivalent professional experience and education in child safety, trust and safety, content moderation, policy enforcement, or a related field.

Required:

• Direct experience in trust and safety, content moderation operations, or policy enforcement, with demonstrated work on child safety issues
• Proven ability to manage content review operations, including quality control and workflow optimization
• Experience building or scaling policy enforcement and content review systems
• Working knowledge of SQL and/or data analytics tools for monitoring queue health, metrics, and enforcement patterns
• Demonstrated ability to spot emerging threats and share findings effectively with product, policy, engineering, and legal partners
• Practical understanding of the operational complexities of enforcing policies at scale in content moderation

Valued:

• Specialized expertise in child safety, child sexual exploitation and abuse (CSEA), and online child protection, including familiarity with content classification systems (COPINE, SAM scale)
• Experience submitting reports to NCMEC, the Internet Watch Foundation (IWF), or comparable bodies
• Knowledge of applicable laws and regulations, including CSAM reporting obligations, KOSA, COPPA, and international counterparts
• Background working with or studying generative AI systems and their potential for misuse in CSEA contexts
• Experience implementing wellness and trauma support programs for reviewers handling harmful content
• Python proficiency for automation and analytics
• Familiarity with hash-matching technologies (PhotoDNA, CSAI Match) or similar perceptual hashing approaches
• Understanding of age verification technology and its role in child protection
• Prior trust and safety role at a technology platform, with knowledge of how product policy intersects with legal child protection duties

Working at Anthropic

Anthropic is committed to creating AI that is safe, benefiting humanity and reflecting diverse perspectives. We are headquartered in San Francisco and offer competitive pay, optional equity donation matching, abundant paid time off, paid parental leave, and flexible schedules. Currently, we ask all team members to be in an office 25% of the time; your specific role may have different requirements. We sponsor visas and work with an immigration attorney to support eligible candidates. We value communication and collaboration and believe that representation strengthens our work on AI safety and ethics.

Apply Today

To apply, complete your application directly on this page, or you'll be redirected to the employer's application platform to finish submitting there.