Staff/Senior AI Engineer, AI for Code

Responsibilities

We are representing a confidential developer tools organization in their search for a Staff/Senior AI Engineer to join their AI for Code team in London. In this role, you will build production-ready coding agents and agentic workflows that support real developer tasks within enterprise development environments.

Your core responsibilities will include:

• Building and deploying coding agents that handle multi-step developer workflows in production environments
• Transforming model capabilities into reliable product features through prompt engineering, context design, fine-tuning, instruction-tuning, and post-training optimization
• Designing agent execution loops, including tool use, execution strategy, safeguards, and task completion validation
• Creating comprehensive evaluation infrastructure with online and offline testing, regression monitoring, failure analysis, and release criteria
• Establishing feedback loops using production logs, user signals, and edge cases to continuously improve data quality and agent performance
• Working with both hosted frontier APIs and self-hosted or open-weight models, making architectural decisions based on capability, latency, reliability, privacy, and cost considerations
• Collaborating with product managers, software engineers, ML engineers, and researchers to deliver end-to-end features
• Providing technical leadership and defining direction in areas requiring strong engineering judgment rather than established patterns

What We're Looking For

Our client seeks candidates with:

• Strong software engineering fundamentals with proven experience shipping complex systems to production
• Hands-on experience building LLM-powered products, coding agents, or similar AI systems
• Demonstrated ability to improve model behavior through systematic iteration using prompting, context engineering, fine-tuning, preference optimization, or other post-training methods
• Practical experience designing and implementing evaluation frameworks and benchmarking for LLM systems, including task-specific success metrics and regression detection
• Experience working with real-world production signals rather than only clean benchmark datasets
• Strong judgment regarding trade-offs between model quality, latency, reliability, privacy, and cost
• Comfort working in ambiguous environments and taking ownership of technical direction across multiple iterations
• Excellent communication skills with ability to align engineering and product stakeholders

Within your first year, success will look like shipping one or more agent capabilities that users rely on for production work, establishing robust evaluation coverage with clear release criteria, and helping the team build repeatable processes from concept through scaled deployment.

How We Work With You

When you apply through Get A Job.ai, our talent team will review your application and conduct an initial screening call to understand your background and goals. If there's a strong match, we will submit your profile to our client for consideration. Please note that you should not contact the client directly—all communication and coordination will flow through our recruiting team to ensure the best experience for everyone involved.

Pay

Compensation details will be discussed during the screening process and are competitive for the London market at the Staff/Senior level.

Equal Employment Opportunity: Get A Job.ai is committed to inclusive hiring practices. We welcome applications from candidates of all backgrounds and work to ensure fair consideration throughout our recruitment process.