Senior Data Engineer

Responsibilities

We are representing a leading B2B data and intelligence organization seeking a Senior Data Engineer to join their core Enterprise Data Engineering team in London. In this role, you will design and expand enterprise-level data infrastructure that enables internal teams to interact with data comprehensively.

Your day-to-day responsibilities will include:

• Design, develop, and maintain high-performance, product-centric data pipelines using Airflow, DBT, and Python
• Architect and optimize massive-scale data warehouse and lakehouse infrastructure, primarily using Snowflake
• Lead the integration of diverse structured and unstructured data sources (web data, third-party APIs) into the data ecosystem
• Define roadmap priorities that anticipate internal consumer needs and drive competitive advantage in data and AI capabilities
• Serve as a trusted advisor to leadership on strategy, AI-readiness, and data infrastructure investment decisions
• Collaborate with ML engineers, data scientists, and product managers to translate business needs into scalable data solutions
• Define, monitor, and enforce data quality SLAs across all pipelines and products
• Participate in a shared on-call rotation (PagerDuty), responding to pipeline and platform incidents, performing root-cause analysis, and driving remediation
• Triage production issues quickly and escalate appropriately based on severity, blast radius, and customer impact
• Mentor and coach junior engineers, promoting best practices in code quality, data architecture, incident response, and operational excellence
• Participate in architectural decisions and long-term strategy planning for enterprise-wide data infrastructure
• Contribute to and maintain runbooks, on-call documentation, and operational playbooks

What We're Looking For

Required Technical Skills:

• Expert-level SQL for building performant, scalable queries and transformations on massive datasets
• Strong Python programming skills with a focus on distributed computing, data manipulation, and building robust APIs
• Production-level experience with large-scale batch and streaming data processing
• Hands-on experience with DBT (Data Build Tool) for advanced data modeling and transformations
• Deep knowledge of Snowflake data warehouse design, optimization, and cost modeling
• Experience owning production systems, including on-call rotations, incident response, and postmortem processes
• Strong understanding of data architecture concepts, including data lakes, event-driven architectures (Kafka), ETL/ELT, and data mesh
• Proficiency with cloud platforms (GCP and/or AWS) and infrastructure as code (Terraform)
• Experience with monitoring/observability tooling (Datadog, Monte Carlo, Grafana) for proactive detection of data quality and pipeline issues
• Familiarity with CI/CD practices applied to data workflows

Required Non-Technical Skills:

• Excellent communication skills – ability to explain complex technical concepts to both engineering teams and non-technical stakeholders, especially during high-pressure incidents
• Strategic and product-oriented thinking – can translate business objectives and customer needs into scalable, high-impact data solutions
• Leadership and mentorship – experience guiding and uplifting engineering teams
• Stakeholder management – able to collaborate effectively across departments and communicate clearly when issues arise
• Sound judgment under ambiguity – comfortable making decisions with incomplete information
• Ownership and accountability – takes responsibility for the full lifecycle of what you build, including production support
• Strong documentation habits and ability to evangelize best practices

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 8+ years of progressive experience in data engineering, with a track record of leadership and impact
• Demonstrated experience in implementing or scaling data infrastructure for a data-centric product company
• Experience participating in an on-call rotation supporting production data systems

How We Work with You

Our talent team at Get A Job.ai partners with exceptional B2B technology organizations to connect them with senior-level engineering talent. When you apply through our platform, a dedicated recruiter will review your profile and schedule an initial screening conversation. If there's a strong match, we'll submit your candidacy to our client for consideration. Please apply exclusively through Get A Job.ai – do not contact the client directly, as all applications must come through our recruiting process.

Pay

Compensation details will be discussed during the screening process and are competitive for a Senior Data Engineer role in London.

Equal Opportunity

Get A Job.ai is committed to inclusive recruiting practices. We welcome candidates from all backgrounds and work with clients who share our commitment to equal employment opportunity.