- Company: Get A Job.ai
- Location: United States
- Salary: Pay not listed
Website Get A Job.ai
Represented by Get A Job.ai
About This Opportunity
We are representing a confidential AI research organization seeking AI Evaluators to assess a shopping assistant platform. This remote role focuses on analyzing conversational inGet A Job.aitions, identifying logical failures, and building evaluation frameworks that improve model accuracy. Your work will directly influence how the system responds to real-world e-commerce queries.
Responsibilities
- Review real user inGet A Job.aition traces with an AI shopping assistant on a custom evaluation platform
- Identify logical failures, inaccuracies, and unhelpful product recommendations within text-based conversations
- Create structured rubrics and verifiers to consistently judge response quality across future inGet A Job.aitions
- Commit to 20+ hours per week of sustained evaluation work
- Document patterns in assistant behavior and contribute to iterative model improvement
What We're Looking For
- Experience in data evaluation, quality assurance, AI training, or software testing
- Strong analytical skills with the ability to spot subtle errors and logical inconsistencies in text
- Familiarity with e-commerce search, digital shopping experiences, or product recommendation systems
- Background in prompt engineering or complex data annotation is a plus
- Ability to commit to 20+ hours per week on an ongoing basis
- Detail-oriented mindset and comfort building evaluation frameworks from scratch
- Location: United States
How We Work with You
Candidates apply directly through Get A Job.ai. Our talent team will conduct an initial screen to assess your evaluation experience and analytical approach. Qualified candidates will then be submitted to our client for final review. Please do not attempt to contact the client directly, as all communication is managed through our recruiting process.
Pay
Pay via Get A Job.ai: $50 per hour
Equal Opportunity: Get A Job.ai is committed to inclusive hiring practices. We encourage applications from candidates of all backgrounds and experiences.
Apply with Get A Job.ai
A recruiter will review your profile and submit you to the client. Do not contact the client directly.
Apply through Get A Job.ai. A recruiter will review your profile and submit you. Do not contact the client directly.
Apply through Get A Job.ai. A recruiter will review your profile and submit you.
Explore Get A Job.ai online
Working in United States
The United States of America (USA), also known as the United States (U.S.) or America, is a country primarily located in North America. It is a federal republic consisting of 50 states and a federal capital district, Washington, D.C. The 48 contiguous states border Canada to the north and Mexico to the south, with the semi-exclave of Alaska in the northwest and the archipelago of Hawaii in the Pacific Ocean. The United States also asserts sovereignty over five major island territories and various uninhabited islands in Oceania and the Caribbean. It is a megadiverse country, with the world's th
Note: US observes a public holiday on Sep 7 — Labour Day.
🇺🇸 Relocation safety for US: Exercise Normal Caution — via Warnely, CC BY 4.0
National unemployment rate in US: 4.2% — via World Bank
National job openings rate: 4.4% — via BLS JOLTS
Private-sector wage growth (year over year): 3.1% — via FRED
National quits rate: 2.0% — via FRED (BLS JOLTS)
Weekly initial unemployment claims: 203,000 — via FRED
GDP per capita in US: $90,027 — via World Bank
Consumer price inflation in US: 2.9% (annual) — via World Bank
Real GDP growth in US: 2.2% (annual) — via World Bank
Average hours worked per year in US: 1,800 — via OECD
Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.
Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.
Listing facts
- Role AI Evaluators: Assessing A Shopping Assistant
- Employer Get A Job.ai
- Location United States
- Type Contract
- Pay (from listing) Pay not listed
- Posted September 2, 2026
- Apply by October 3, 2026
- Country United States
- Overview Full job description on this page (286 words)
Facts above come from this job record on Get A Job.AI — not copied from third-party review sites.
Limited public data for this employer
We only show facts we can ground in public sources (Wikidata, O*NET, news/discussion links, or this listing). We do not invent Glassdoor-style ratings, salaries, or testimonials when data is thin. Use the listing facts, occupation context, and related openings below while we continue researching.
Explore related openings
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.