Engineering Manager | Inference

About This Opportunity

We are representing a confidential AI technology organization seeking an Engineering Manager to lead their Production Inference team in London. Our client operates at the forefront of language AI, serving millions of users globally with secure, intelligent solutions.

This is a people-leadership role focused on directing a high-performing team of research scientists and ML engineers responsible for the systems that serve AI models reliably and efficiently at scale. You will sit at the intersection of research-grade technical ambition and production-grade operational discipline, ensuring models reach users with optimal latency, reliability, and cost performance.

Responsibilities

• Lead and develop a team of research scientists and ML engineers working on performance-critical model serving systems, building strong development plans and fostering a culture of technical rigour
• Own the research and development roadmap for production inference systems, balancing near-term reliability commitments with longer-horizon research initiatives on inference efficiency
• Serve as the primary technical interface between the inference team and adjacent functions including foundational models research, infrastructure, and product teams
• Drive reliability, efficiency, and cost performance of the model serving stack, including strategic decisions around serving infrastructure evolution, load balancing, autoscaling, and hardware utilisation
• Operate autonomously to define team direction and deliver results in an environment where requirements may be ambiguous or evolving
• Participate actively in identifying, assessing, and recruiting research and engineering talent

What We're Looking For

• Proven experience leading teams of researchers or ML engineers with a track record of developing talent and balancing research quality with production reliability
• Strong background in Computer Science, Mathematics, Physics, or a comparable quantitative discipline, or equivalent ML/systems research depth
• Strong foundation in production ML systems, inference optimisation, or model serving at scale; experience with LLM inference, speculative decoding, quantisation, or serving infrastructure is highly valued
• Comfort operating across the full model lifecycle from training handoff through production deployment, monitoring, and efficiency improvement
• Excellent communication skills with ability to translate complex technical direction into clear goals for both technical and non-technical stakeholders
• Solution-oriented and decisive approach, able to define direction and drive outcomes independently

How We Work With You

Candidates apply directly through Get A Job.ai. Our talent team will conduct an initial screening to understand your background and fit for the role. Qualified candidates are then submitted to our client for consideration. Please do not attempt to contact the client directly, as all communication is coordinated through our recruiting team to ensure a smooth process.

Pay

Compensation details will be discussed during the screening process based on experience and qualifications.

Equal Opportunity: Get A Job.ai is committed to inclusive hiring practices. We welcome applications from candidates of all backgrounds and work to ensure fair consideration throughout our process.