HumanSignal
About HumanSignal
Real-world data is the competitive edge in AI.
HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery.
We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide.
We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out.
If you want to do work that materially shapes how the next generation of AI products gets built, we’d love to talk.
Level: Individual Contributor
Compensation: $70,000 – $90,000
Location: San Francisco, CA
About the Role
HumanSignal specializes in operationally complex, multimodal data collection and annotation — delivering the datasets that frontier AI research requires and remote workforce marketplaces can’t. We own projects end-to-end, from scoping and protocol design through final delivery, running on-site and distributed expert workforces across 50+ knowledge domains, 30+ languages, and 75+ countries. Our work spans RLHF, evals, red-teaming, and custom multimodal data creation, all powered by Label Studio Enterprise and built on a foundation of rigorous quality workflows, ethical sourcing, and full data security. This role sits at the operational core of that delivery engine — responsible for ensuring our clients get the highest-quality data on time, every time.
This role is not for everyone. HumanSignal Services operates at the intersection of frontier AI research and large-scale human data delivery — and the work is fast, demanding, and unforgiving of dropped balls. You’ll own complex, high-stakes data programs end-to-end, managing expert workforces, navigating shifting customer requirements, and holding quality and delivery timelines simultaneously. There is no playbook handed to you. You will build it, break it, and rebuild it better. If you thrive under pressure, take personal pride in operational excellence, and don’t quit when a project gets hard — this is the role for you
What You’ll Do
The day-to-day is intense by design. You’ll juggle multiple programs at once, each with its own contributors, quality standards, and customer expectations. You’ll make hard calls with incomplete information, hold contributors and vendors accountable, and find creative solutions to problems that don’t have obvious answers. The expectation is simple: own the outcome, no excuses. High performers here grow faster than anywhere else in the industry. The bar is high — and that’s the point.
What You’ll Do
- Build and drive critical operational processes to meet day-to-day customer delivery commitments
- Manage daily operations across multiple Fellow or contributor programs, including onboarding, workflow coordination, and ongoing program health
- Maintain operational trackers and documentation to ensure consistent execution and follow-through across the team
- Monitor contributor engagement and flag retention or performance risks before they become delivery issues
- Create an effective feedback loop between frontline operations, product, strategy, and customers
- Identify recurring bottlenecks and recommend process improvements; run pilots and experiments to test solutions
- Collaborate with SPLs, TPMs, Customer Operations, and Product teams to improve processes for new and existing customers
Required Qualifications
- 2+ years of experience in an operational role or top-tier consulting firm
- Undergraduate degree in an analytics-heavy field (Engineering, Economics, or related)
- Action-oriented; balances creative problem-solving with scrappy execution
- Strong analytical and process-improvement capability
- Proficiency in SQL or demonstrated analytical tooling skills
Preferred Qualifications
- Experience in marketplace, logistics, or workforce platform operations
- Familiarity with tools like Zendesk, Notion, or Airtable
- Exposure to AI/ML workflows, data annotation, or contributor management
- Entrepreneurial mindset; comfortable in fast-moving, ambiguous environments
To apply for this job please visit job-boards.greenhouse.io.
Explore HumanSignal online
Working in San Francisco
San Francisco, officially the City and County of San Francisco, is the fourth-most populous city in California and the 17th-most populous in the United States, with a population of 826,079 in 2025. Among U.S. cities with a population of 200,000 or more, San Francisco is ranked first by per capita income, second by population density, and sixth by aggregate income as of 2024. Some 4.6 million residents live in the city's metropolitan statistical area, which is the 13th-largest in the United States. Around 9.2 million live in the San Jose–San Francisco–Oakland combined statistical area, the fift
Market context
- Similar listings in San Francisco, California 3
Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.
Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.