Data Engineer

About This Opportunity

We are representing a confidential technology organization in the United Kingdom that is seeking a talented Data Engineer to join their data and analytics team. This is a senior individual contributor role focused on designing, building, and operating Python-based web applications, agentic workflows, and supporting data services that empower business teams with trusted data and intelligent automation.

In this position, you will combine strong data engineering foundations with hands-on application development, leveraging AI agents, robust data infrastructure, and business system integrations to improve decision-making and automate operational workflows. You will take solutions from initial requirements through to production, working closely with engineers, analysts, and business stakeholders.

Responsibilities

• Design, develop, and operate production-ready Python web applications that help business teams access trusted data and improve operational workflows
• Build applications and workflows that connect AI agents to approved tools, APIs, datasets, and business systems with clear security boundaries
• Partner with analysts, engineers, and business stakeholders to translate user needs into scalable, working solutions
• Use AI-assisted coding tools to build and maintain front ends alongside Python backend services, or enable business teams to develop their own interfaces against well-defined backend APIs
• Design secure, reusable backend services with proper authentication, authorization, input validation, and business rules enforcement
• Implement evaluation, monitoring, audit trails, and safeguards for agentic workflows, including constrained tool permissions and human approval for consequential actions
• Design, build, and enhance Python-based batch and streaming data pipelines, trusted datasets, and reusable data models
• Own key platform components using AWS services including S3, Lambda, Aurora PostgreSQL, Athena, Glue, and Redshift
• Build and maintain orchestration, CI/CD workflows, automated testing, deployment processes, and monitoring for applications and data workflows
• Apply robust error handling, idempotent processing, retry and recovery mechanisms to improve reliability and operational performance
• Provide technical leadership through design reviews, code reviews, and mentoring of engineers and business application builders
• Contribute to standards for data quality, documentation, observability, security, and access management

What We're Looking For

Essential qualifications:

• Strong experience designing, building, and operating production-grade data pipelines and platforms using Python
• Experience building and supporting Python web applications, backend services, and APIs that integrate data and business systems
• Practical experience developing applications or workflows that use large language models or AI agents, including connecting them to tools, APIs, and governed data sources
• Experience using AI-assisted coding tools effectively, with ability to understand, review, test, debug, and maintain generated code
• Ability to build usable web front ends with AI-assisted tools or enable business colleagues to develop and maintain front ends against well-defined backend services
• Strong hands-on experience with modern orchestration, automated testing, CI/CD, deployment, and monitoring practices in production environments
• Experience building cloud-based solutions using AWS services, including data storage, processing, and query technologies
• Strong understanding of data modelling, schema design, data quality, and performance optimization across relational and analytical systems
• Experience working with both batch and streaming data pipelines, including operational support and troubleshooting
• Strong understanding of security, access control, and governance for cloud-based data platforms and applications
• Practical understanding of reliability and security considerations for agentic applications, including permission boundaries, evaluation, and auditability
• Experience providing technical leadership as a senior individual contributor through design reviews, code reviews, and mentoring
• Ability to collaborate effectively with technical and non-technical stakeholders and translate business requirements into practical solutions
• Must hold the right to work in the UK (visa sponsorship is not available for this position)

Desirable qualifications:

• Experience with Python web application frameworks such as Streamlit, Flask, or FastAPI
• Working knowledge of JavaScript or TypeScript and a modern front-end framework
• Experience with agent orchestration, retrieval over business data, or automated evaluation of AI-enabled applications
• Experience with Prefect or similar workflow orchestration platforms
• Experience with PostgreSQL, Redshift, ClickHouse, or similar database and data warehouse technologies
• Experience with Infrastructure as Code and reusable application deployment patterns
• Familiarity with dbt and analytics engineering practices
• Experience improving observability, operational monitoring, application performance, and cloud cost optimization

How We Work with You

As a recruiting partner, Get A Job.ai connects exceptional talent with outstanding opportunities. When you apply through our platform, one of our experienced recruiters will review your qualifications and conduct an initial screening. If there's a strong match, we'll submit your profile to our client for consideration. Please note that all applications must go through Get A Job.ai—candidates should not contact the employer directly.

Our talent team will keep you informed throughout the process and provide guidance on interview preparation, expectations, and next steps. We're here to advocate for you and ensure a smooth, professional experience.

Pay

Compensation details will be discussed during the screening process with our recruiting team.

Equal Employment Opportunity: Get A Job.ai is committed to inclusive hiring practices and welcomes applications from candidates of all backgrounds. We provide equal employment opportunities regardless of race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.