Senior AI Backend Engineer

ob Title: Senior AI Backend Engineer
Key Skills: Python, FastAPI, REST APIs, Distributed Systems, LLM Orchestration, AWS, Docker, CI/CD, AI Evaluation Frameworks, STT Pipelines
Experience: +7 YOE
Location: LATAM (Exclusive)
Mode: Remote

We at Coforge are hiring a Senior AI Backend Engineer (21736) with the following skill set.

Key Responsibilities

• Build and operate the production backend for a Voice-to-Action AI pipeline, including Speech-to-Text (STT) and LLM orchestration services
• Design scalable and reliable backend systems within an existing distributed architecture
• Develop instrumentation, evaluation, and regression frameworks for AI workflows and LLM-based systems
• Define and monitor key quality metrics such as transcription accuracy, normalization drift, edit rate, and field-audio performance
• Establish feedback loops and calibration practices to optimize non-deterministic AI systems in production
• Evaluate and benchmark STT and LLM providers against internal performance metrics
• Build and maintain scalable cloud-native services using AWS, Docker, and CI/CD pipelines
• Collaborate with backend engineering teams to improve operational excellence and platform scalability
• Support the adoption of AI-assisted and agentic engineering workflows across the organization
• Contribute to broader backend platform initiatives after the Voice-to-Action pipeline reaches production readiness

Required Skills & Qualifications

• 7+ years of experience in backend engineering with strong expertise in Python
• Hands-on experience with FastAPI or similar backend frameworks
• Strong understanding of REST API development, service architecture, and distributed systems
• Proven experience deploying and operating production systems on AWS, GCP, or Azure
• Strong knowledge of Docker, CI/CD pipelines, cloud infrastructure, and operational best practices
• Experience building and maintaining production-grade AI/LLM systems
• Proven track record of implementing instrumentation, evaluation, regression testing, and monitoring for non-deterministic AI components
• Strong analytical and problem-solving mindset with focus on measurement and reliability
• Ability to quickly learn new domains and adapt to evolving technologies
• Experience working in fast-paced engineering environments with changing requirements

Preferred Skills

• Deep experience with LLM orchestration frameworks and AI evaluation infrastructure
• Experience with hosted LLM APIs such as OpenAI, Anthropic, Bedrock, or Vertex AI
• Familiarity with STT/ASR providers such as Whisper, Deepgram, or AssemblyAI
• Knowledge of MLOps and AI observability/monitoring tools
• Experience with agentic coding workflows such as Claude Code, Cursor, or similar platforms
• Backend experience in TypeScript or Node.js environments
• Experience with mobile voice pipelines or audio processing systems
• Bilingual or multilingual NLP experience
• Strong technical leadership and mentorship capabilities

Posted On: 05-06-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

Originally posted on Himalayas