About Cresta
Source: Wikipedia
Cresta
Cresta unlocks the true potential of the customer experience, turning every conversation into a competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent augmentation, and comprehensive conversation intelligence to drive revenue and efficiency gains across every channel. The world’s leading companies, including United Airlines, Cox Communications, and Marriott, use Cresta to power world-class customer experiences every day.
Born from the Stanford AI Lab, Cresta has raised more than $270 million from the world’s leading investors, including a16z, Greylock, and Sequoia. Cresta’s leadership includes some of the leading minds in AI today. Our CEO, Ping Wu, founded and led Google’s Contact Center AI and Vertex AI platforms before joining Cresta to build the future of AI-driven customer experiences.
Over the next few years, AI is going to redefine how people all over the world interact with businesses every day. Come build that future at Cresta.
Join us on this thrilling journey to revolutionize the workforce with AI. The future of work is here, and it’s at Cresta.
This is a hands-on role where you will evaluate the behavior, accuracy, and reliability of Cresta’s AI Agents and Agent Assist systems.
Unlike traditional QA, this work sits at the intersection of:
- AI behavior analysis
- Intent recognition evaluation
- Conversation quality assessment
- Model output auditing
- Light prompt testing and refinement
Responsibilities:
- Execute structured test plans for AI Agent implementations
- Validate that intents, entities, and workflows trigger correctly
- Identify behavioral inconsistencies, misclassifications, or hallucinations
- Review and validate AI-generated suggestions, summaries, and classifications
- Provide actionable feedback to improve intent models and redaction/PII handling
- Run bias, redaction, and transcription accuracy checks
- Spot patterns or emerging issues across test sets
- Contribute ideas for improving internal QA processes and tools
Qualifications We Value:
- AI/ML, NLP, or chatbots
- Product quality and user experience
- Linguistics, conversation analysis, or human–AI interaction
- Exploring a career in AI evaluation, AI ops, or product QA
Perks & Benefits:
- $30-$50 per hour subject to taxes
- Lunch can be expensed (up to $25) while working in the office.
- PT0: 4 days
This posting will be used to fill a newly-created role.
We have noticed a rise in recruiting impersonations across the industry, where scammers attempt to access candidates’ personal and financial information through fake interviews and offers. All Cresta recruiting email communications will always come from the @cresta.ai domain. Any outreach claiming to be from Cresta via other sources should be ignored. If you are uncertain whether you have been contacted by an official Cresta employee, reach out to recruiting@cresta.com.
To apply for this job please visit job-boards.greenhouse.io.
Working in Toronto
Toronto is the most populous city in Canada and the capital city of the Canadian province of Ontario. It is located on a harbour at the northwestern shore of Lake Ontario. The city is the fourth-most populous city in North America, behind Mexico City, New York City, and Los Angeles, with a census population of 2,794,356 as of 2021. The Greater Toronto Area (GTA) is constituted of Toronto proper and four surrounding regions, Peel, York, Durham, and Halton, and has a population of 6,712,341, while the Toronto census metropolitan area (CMA), with a somewhat different definition, has a population
What people say about Cresta
- What does it take to restore a World War Two Spitfire?
- Ask HN: What projects are you working on?
- Troubled welds on the Bay Bridge
- Running Out of Power in a Tesla on the Side of a Highway
Recent news
- TELUS Digital Becomes Cresta's Implementation Partner - CMSWire
- Villa Cresta in Photos - Robb Report
- Details Released After Driver Shot In Unincorporated Murrietas La Cresta Community - Patch
- Cresta Launches Conductor, the Agent for AI Agent Development - PR Newswire
- TELUS Digital Partners with Cresta to Deliver AI-Powered Customer Experience Platform - The Fast Mode
Aggregated from public discussions and news; opinions are the authors’ own.
More jobs at Cresta
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.