Epifi
What you’ll work on
Evaluation systems for AI features
- Help build the eval backbone our AI features ship against — failure taxonomies, LLM-as-judge rubrics, golden datasets, calibration against human judgment.
- Learn what it takes to keep automated scores honest as models and prompts change. A feature with no eval has no quality floor.
- Get hands-on with how we route work across models — balancing cost, quality, and latency per task.
- Help run the experiments that justify those choices and catch regressions.
- Work on turning noisy, real-world signals into scores you can actually trust — grounded in real statistical rigor, not vibes.
- Help move heuristic-driven approaches toward calibrated, monitored systems.
- Get exposure to the full lifecycle — feature pipelines, model versioning, rollout, monitoring for drift and silent quality decay.
- Work alongside engineering to see how models get served reliably at low latency.
Must have
- Currently pursuing or recently completed a degree in CS, DS, ML, or a related field.
- Some hands-on DS/ML experience — coursework, personal projects, research, or a prior internship — where you’ve built and run something end to end, not just notebooks.
- Comfort with Python and working SQL knowledge.
- Basic grounding in applied statistics — you can explain what a metric means and when it might be misleading.
- A builder’s instinct — genuinely curious about product decisions, backend, or frontend, not just the modeling layer.
- Some exposure to LLMs — prompting, using APIs, or experimenting with model behavior.
- Any exposure to evaluation or observability tooling for LLM features.
- Coursework or projects in information retrieval, entity-matching, or record-linkage.
- Interest in developer-productivity, code analytics, or DevEx data.
To apply for this job please visit jobs.lever.co.
Explore Epifi online
Working in Bangalore, Karnataka
Weather right now in Bangalore, Karnataka: checking… · Local time: · Air quality: · Daylight: · UV index:
Bengaluru, also known as Bangalore, is the capital and largest city of the southern Indian state of Karnataka. As per the 2011 census, the city had a population of 8.4 million, making it the third most populous city in India and the most populous in South India. The Bengaluru metropolitan area had a population of around 8.5 million, making it the fifth most populous urban agglomeration in the country. It is located towards the southern end of the Deccan Plateau, at an altitude of 900 m (3,000 ft) above sea level. The city is known as India's "Garden City", due to its parks and greenery.
Karnataka is a state in the southwestern coast of India. It was formed as Mysore State on 1 November 1956, with the passage of the States Reorganisation Act, and renamed Karnataka in 1973. The state is bordered by the Lakshadweep Sea to the west, Goa to the northwest, Maharashtra to the north, Telangana to the northeast, Andhra Pradesh to the east, Tamil Nadu to the southeast, and Kerala to the so
🇮🇳 Relocation safety for India: High Risk — via Warnely, CC BY 4.0
National unemployment rate in India: 4.2% — via World Bank
- Elevation 921m (3,022 ft)
Source: Wikipedia (state)
Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.
Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.
