About mercor
mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.
Position: Code-Data Eval Author — Software Test Engineer / SDET
Type:Contract
Compensation:$30–$100/hour
Location:Remote
Commitment:30+ hours/week
Role Responsibilities
- Design verifiers and correctness rubrics for coding tasks to ensure AI agent code functionality.
- Enumerate edge cases and build adversarial test cases for comprehensive agent/model evaluation.
- Grade agent trajectories and improve test/rubric quality through detailed review.
- Work independently and asynchronously to meet deadlines while enhancing AI model performance.
- Collaborate with subject matter experts to ensure test consistency and relevance.
Qualifications
Must-Have
- 5+ years as an SDET / software test engineer at a real product organization.
- Proficiency in writing code and tests using automation frameworks like pytest, Playwright, Cypress.
- Experience with CI/CD processes; SDET preferred over manual-only QA.
- Clear written communication skills.
Preferred
- Familiarity with AI tools and evaluations.
Interview Process
- Mercor Technical Screen: Paid $200 for completing all three steps.
- Live Code Review Session.
- Domain Expert Interview.
Compensation & Legal
- Hourly contractor.
- Paid weekly via Stripe Connect.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
To apply for this job please visit himalayas.app.
Working in Uruguay
Uruguay, officially the Oriental Republic of Uruguay, is a country in South America. It shares borders with Argentina to its west and southwest and Brazil to its north and northeast, while bordering the Río de la Plata to the south and the Atlantic Ocean to the southeast. It is part of the Southern Cone region of South America. Uruguay covers an area of approximately 176,215 square kilometers (68,037 sq mi). It has a population of almost 3.5 million people, of whom nearly 2 million live in the metropolitan area of its capital and largest city, Montevideo.
What people say about mercor
- Reasons to compete in this year’s Battlecode programming competition at MIT
- GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
- GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
- GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
Recent news
- New troubles at Mercor: Infighting, ‘face time slavery,’ and ‘inhumane working conditions’ - Gazetteer SF
- AI recruiting startup Mercor takes more of Meta's former office space at 181 Fremont - The Business Journals
- Mercor CEO Says It Now Spends More on AI Tokens Than Employee Salaries - Business Insider
- Mercor’s Brendan Foody calls out Sequoia, accusing it of ‘dual-pricing’ valuation tricks - TechCrunch
- Mercor, a $10 billion AI startup, confirms it was caught up in a major security incident - Fortune
Aggregated from public discussions and news; opinions are the authors’ own.
More jobs at mercor
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.