About mercor
mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.
Position: AI Model Evaluation Specialist
Type:Contract
Compensation:$25–$35/hour
Commitment:20 hours/week
Role Responsibilities
- Write realistic prompts reflecting professional and consumer domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy and practical usefulness.
- Identify fabricated claims and misleading reasoning in model outputs.
- Score and rank model responses using structured rubrics.
- Provide written justifications with specific evidence for evaluations.
Qualifications
Must-Have
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete the Model Response Evaluation assessment.
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
To apply for this job please visit himalayas.app.
Working in Singapore
Singapore, officially the Republic of Singapore, is an island country in Southeast Asia. Its territory comprises a main island, over 60 satellite islands and islets, and one outlying islet. The country is about one degree of latitude north of the equator, off the southern tip of the Malay Peninsula, bordering the Strait of Malacca to the west, the Singapore Strait to the south along with the Riau Islands in Indonesia, the South China Sea to the east and the Straits of Johor along with the State of Johor in Malaysia to the north.
What people say about mercor
- Reasons to compete in this year’s Battlecode programming competition at MIT
- GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
- GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
- GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2
Recent news
- New troubles at Mercor: Infighting, ‘face time slavery,’ and ‘inhumane working conditions’ - Gazetteer SF
- AI recruiting startup Mercor takes more of Meta's former office space at 181 Fremont - The Business Journals
- Mercor CEO Says It Now Spends More on AI Tokens Than Employee Salaries - Business Insider
- Mercor’s Brendan Foody calls out Sequoia, accusing it of ‘dual-pricing’ valuation tricks - TechCrunch
- Mercor, a $10 billion AI startup, confirms it was caught up in a major security incident - Fortune
Aggregated from public discussions and news; opinions are the authors’ own.
More jobs at mercor
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.