Data Engineer Lead

About This Opportunity

Our talent team is representing a confidential technology organization in the United Kingdom seeking a Data Engineer Lead to drive the engineering delivery and productionisation of a major data intelligence platform. This is a leadership role combining technical architecture, delivery management, and stakeholder coordination across data engineering, analytics, machine learning, security, and governance disciplines.

You will own the technical path from prototype to production—transforming use-case experiments and analytical models into secure, governed, scalable data products and platform services.

Responsibilities

• Own the data engineering and platform delivery strategy, target architecture, roadmap, and productionisation standards
• Lead design and delivery of ingestion, event streaming, transformation, lakehouse, serving, and analytical data products
• Establish engineering patterns for batch and low-latency data pipelines, APIs, feature pipelines, and authorised data access
• Define and implement data quality, lineage, metadata, catalogue, master/reference data, and reconciliation controls
• Embed CI/CD, Infrastructure as Code, automated testing, observability, FinOps, and secure configuration into the platform lifecycle
• Lead production readiness across resilience, scalability, backup, recovery, monitoring, support, data protection, and service management
• Coordinate platform dependencies, environments, suppliers, and interfaces with wider organizational services
• Set technical priorities, estimate delivery, manage engineering risks, and mentor data engineers
• Support governance and stakeholder decisions with transparent measures of platform quality, readiness, performance, and value

What We're Looking For

Required Skills and Capabilities:

• Data engineering leadership and platform architecture expertise
• Cloud data platforms and lakehouse patterns
• Batch, streaming, and event-driven data pipeline design
• SQL, Python, and distributed data processing
• Data modelling, data products, and semantic layers
• Data quality, observability, lineage, metadata, and cataloguing
• Data governance, security, privacy, and access control
• MLOps and productionisation of analytical or AI services
• CI/CD, Infrastructure as Code, and automated data testing
• Reliability engineering, FinOps, and service transition management

Required Experience:

• Leadership of data engineering delivery for a production cloud data platform
• Taking prototypes, notebooks, or analytical use cases through production engineering and operational acceptance
• Designing scalable ingestion, transformation, and serving patterns
• Implementing data quality, governance, security, and platform observability
• Coordinating product, analytics, engineering, infrastructure, security, and operational stakeholders

Desired Experience:

• Databricks, Microsoft Fabric, Azure data services, AWS data services, or comparable platforms
• Data intelligence platform, digital supply chain, logistics, or defence sector data use cases
• Event streaming, feature stores, MLOps, or AI/ML platform engineering
• Migration of sensitive enterprise data and integration with operational systems
• Establishing a data platform team, engineering standards, and reusable accelerators

Security Clearance:

• SC clearance required to start and for the role

How We Work with You

When you apply through Get A Job.ai, a recruiter from our team will conduct an initial screening to understand your background, technical expertise, and leadership experience. If there's a strong match, we will submit your profile to our client for consideration. Please do not contact the client directly—we manage the entire introduction and interview coordination process on your behalf.

Equal Opportunity

Get A Job.ai is committed to providing equal employment opportunities to all applicants regardless of race, color, religion, sex, national origin, age, disability, genetics, veteran status, sexual orientation, gender identity, or any other protected characteristic. We welcome applications from every part of the community and celebrate diverse perspectives and contributions.