- Company: Get A Job.ai
- Location: United States
- Salary: Pay not listed
Website Get A Job.ai
Represented by Get A Job.ai
About This Opportunity
We are representing a confidential AI research organization seeking AI Evaluators to assess a shopping assistant platform. This remote role focuses on analyzing conversational inGet A Job.aitions, identifying logical failures, and building evaluation frameworks that improve model accuracy. Your work will directly influence how the system responds to real-world e-commerce queries.
Responsibilities
- Review real user inGet A Job.aition traces with an AI shopping assistant on a custom evaluation platform
- Identify logical failures, inaccuracies, and unhelpful product recommendations within text-based conversations
- Create structured rubrics and verifiers to consistently judge response quality across future inGet A Job.aitions
- Commit to 20+ hours per week of sustained evaluation work
- Document patterns in assistant behavior and contribute to iterative model improvement
What We're Looking For
- Experience in data evaluation, quality assurance, AI training, or software testing
- Strong analytical skills with the ability to spot subtle errors and logical inconsistencies in text
- Familiarity with e-commerce search, digital shopping experiences, or product recommendation systems
- Background in prompt engineering or complex data annotation is a plus
- Ability to commit to 20+ hours per week on an ongoing basis
- Detail-oriented mindset and comfort building evaluation frameworks from scratch
- Location: United States
How We Work with You
Candidates apply directly through Get A Job.ai. Our talent team will conduct an initial screen to assess your evaluation experience and analytical approach. Qualified candidates will then be submitted to our client for final review. Please do not attempt to contact the client directly, as all communication is managed through our recruiting process.
Pay
Pay via Get A Job.ai: $50 per hour
Equal Opportunity: Get A Job.ai is committed to inclusive hiring practices. We encourage applications from candidates of all backgrounds and experiences.
Apply with Get A Job.ai
A recruiter will review your profile and submit you to the client. Do not contact the client directly.
Apply through Get A Job.ai. A recruiter will review your profile and submit you. Do not contact the client directly.
Apply through Get A Job.ai. A recruiter will review your profile and submit you.
Local insights for this role are preparing — this section updates automatically in a few seconds (or refresh).
Listing facts
- Role AI Evaluators: Assessing A Shopping Assistant
- Employer Get A Job.ai
- Location United States
- Type Contract
- Pay (from listing) Pay not listed
- Posted September 2, 2026
- Apply by October 3, 2026
- Country United States
- Overview Full job description on this page (286 words)
Facts above come from this job record on Get A Job.AI — not copied from third-party review sites.
Limited public data for this employer
We only show facts we can ground in public sources (Wikidata, O*NET, news/discussion links, or this listing). We do not invent Glassdoor-style ratings, salaries, or testimonials when data is thin. Use the listing facts, occupation context, and related openings below while we continue researching.
Explore related openings
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.