Data Engineer

We are representing a confidential AI hardware and software organization based in Bristol. Our client is seeking a Staff Data Engineer to design, build, and operate Python-based web applications, agentic workflows, and supporting data services for their business teams. This is a senior individual contributor role that combines strong data engineering foundations with hands-on application development.

Responsibilities

• Build business-facing applications. Design, develop and operate production-ready Python web applications that help business teams access trusted data, complete tasks and improve operational workflows.
• Develop agentic capabilities. Build applications and workflows that connect AI agents to approved tools, APIs, datasets and business systems, with clear boundaries on what agents can access and do.
• Translate business needs into working solutions. Partner with analysts, engineers and business stakeholders to understand user needs, identify appropriate opportunities for automation and take applications from prototype through to supported production services.
• Deliver end-to-end applications where appropriate. Use AI-assisted coding tools to build and maintain front ends alongside Python backend services, taking responsibility for the quality, testing, security and maintainability of generated code.
• Enable business-owned front ends. Where business teams develop and maintain their own interfaces, own the backend and provide documented APIs, reusable templates, examples and practical coaching so colleagues can work effectively with AI-assisted coding tools.
• Establish clear ownership and support arrangements. Agree responsibilities for application changes, testing, releases and ongoing support, including appropriate review and deployment controls for business-maintained front ends.
• Build secure, reusable backend services. Design APIs and application services that enforce authentication, authorisation, input validation and business rules, keeping secrets and sensitive operations within controlled backend systems.
• Engineer reliable agentic workflows. Implement appropriate evaluation, monitoring, audit trails and safeguards, including constrained tool permissions, human approval for consequential actions and safe handling of failures or unreliable model outputs.
• Maintain strong data foundations. Design, build and enhance Python-based batch and streaming pipelines, trusted datasets and reusable data models that support applications, analytics, reporting and operational workloads.
• Own key platform components. Take ownership of relevant backend and data-platform services, using AWS services including S3, Lambda, Aurora PostgreSQL, Athena, Glue and Redshift to deliver secure, resilient and cost-effective solutions.
• Enable safe, repeatable delivery. Build and maintain orchestration, CI/CD workflows, automated testing, deployment processes, monitoring and operational support for applications and data workflows.
• Improve resilience and performance. Apply robust error handling, idempotent processing, retry and recovery mechanisms, and backfill or replay capabilities to improve reliability, scalability and operational performance.
• Apply engineering and governance standards. Contribute to standards for data quality, documentation, observability, security and access management, including least-privilege access, database permissions and secure secrets handling.
• Provide technical leadership. Review designs and code, mentor engineers and guide business application builders, helping raise engineering quality across both manually written and AI-generated software.
• Improve shared capabilities. Identify opportunities to simplify delivery, reuse application patterns and enhance platform capabilities, contributing to technical roadmaps and engineering practices.

What We're Looking For

Essential:

• Strong experience designing, building and operating production-grade data pipelines and platforms using Python
• Experience building and supporting Python web applications, backend services and APIs that integrate data and business systems
• Practical experience developing applications or workflows that use large language models or AI agents, including connecting them to tools, APIs and governed data sources
• Experience using AI-assisted coding tools effectively, with the ability to understand, review, test, debug and maintain generated code rather than relying on generated output without validation
• Ability to either build usable web front ends with AI-assisted tools or enable business colleagues to develop and maintain front ends against well-defined backend services. Sufficient understanding of web development to review integrations and troubleshoot application behaviour is required; deep specialist front-end expertise is not essential
• Strong hands-on experience with modern orchestration, automated testing, CI/CD, deployment and monitoring practices in production environments
• Experience building cloud-based solutions using AWS services, including data storage, processing and query technologies
• Strong understanding of data modelling, schema design, data quality and performance optimisation across relational and analytical systems
• Experience working with both batch and streaming data pipelines, including operational support, troubleshooting and designing systems that recover gracefully from failures
• Strong understanding of security, access control and governance for cloud-based data platforms and applications, including authentication, authorisation, IAM, database permissions and secure secrets management
• Practical understanding of the reliability and security considerations of agentic applications, including permission boundaries, evaluation, auditability and appropriate human oversight
• Experience providing technical leadership as a senior individual contributor through design reviews, code reviews, engineering standards and mentoring
• Ability to collaborate effectively with technical and non-technical stakeholders, translate business requirements into practical, scalable solutions and explain technical concepts clearly
• Ability to coach business colleagues in AI-assisted application development and establish clear boundaries between business-owned interfaces and engineering-owned services

Desirable:

• Experience with Python web application frameworks such as Streamlit, Flask or FastAPI
• Working knowledge of JavaScript or TypeScript and a modern front-end framework
• Experience with agent orchestration, retrieval over business data, or automated evaluation of AI-enabled applications
• Experience with Prefect or a similar workflow orchestration platform
• Experience with streaming or data collection technologies
• Experience with PostgreSQL, Redshift, ClickHouse or similar database and data warehouse technologies
• Experience with Infrastructure as Code and reusable application deployment patterns
• Familiarity with dbt and analytics engineering practices
• Experience improving observability, operational monitoring, application performance and cloud cost optimisation
• Experience contributing to technical roadmaps and platform improvements within a collaborative engineering team
• Experience working within a fast-moving technology or engineering environment

Location: Bristol, UK
Note: Applicants must hold the right to work in the UK. Visa sponsorship is not available for this position.

How We Work With You

Get A Job.ai is representing our client in this search. To apply, please submit your application through our platform at getajob.ai. Our talent team will review your profile and conduct an initial screening. Qualified candidates will then be submitted to our client for consideration. Please do not contact the client directly regarding this opportunity.

Pay

Compensation details will be discussed with qualified candidates during the screening process.

Get A Job.ai is an equal opportunity recruiter. We welcome applications from candidates of all backgrounds and are committed to building diverse and inclusive teams.