Backend Engineer, AI (Agent Systems)

About This Opportunity

We are representing a confidential AI technology company building proactive, AI-native applications for global users. Our client is focused on high-reliability AI systems that power real-world task completion with minimal prompting. Their product aims to reduce hallucinations and bring intelligence to everyday workflows.

As a Backend Engineer focused on AI Agent Systems, you will own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact experience. You'll build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

Responsibilities

• Build and operate backend systems that serve AI-powered features in production
• Design inference pipelines, orchestration layers, and service boundaries around models
• Own production concerns including monitoring, logging, alerting, and incident response
• Optimize latency and throughput across inference, caching, batching, and streaming
• Ensure backend systems run reliably at scale, handling production AI traffic with low latency and high throughput
• Maintain stable, clear APIs that support seamless integration with frontend and ML systems
• Quickly detect, diagnose, and resolve production incidents to minimize user impact
• Drive iterative improvements based on real usage to continuously increase system performance and reliability

What We're Looking For

• Strong backend engineering fundamentals in production environments
• Experience running high-throughput, low-latency services
• Familiarity with AI inference patterns including LLMs, embeddings, and multimodal systems
• Comfortable debugging distributed systems under load
• Bias toward shipping and learning from production behavior
• Ability to bring structure, exercise judgment, and execute independently
• Experience with Python, Node.js, PyTorch, OpenAI/Anthropic/open-source LLMs, SQL and NoSQL databases, Kubernetes, and Docker

How We Work with You

Candidates apply directly through Get A Job.ai. Our talent team will conduct an initial screening to understand your background and assess fit. If there is strong alignment, we will submit your profile to our client for consideration. The client typically conducts 3-4 interviews via virtual meetings and/or onsite. Please do not contact the client directly—all communication flows through our recruiting team to ensure a smooth process.

Pay

Compensation details will be discussed during the screening process based on experience level and client budget.

Equal Opportunity: Get A Job.ai is committed to inclusive recruiting practices. We welcome applications from candidates of all backgrounds and work to ensure fair evaluation throughout the hiring process.