Senior Data Engineer

About This Opportunity

We are representing a confidential sports media and technology organization seeking a Senior Data Engineer to join their growing data team in London. This is a hybrid role requiring three days per week in the office (Tuesday through Thursday).

Our client operates at significant scale, processing complex data workloads that serve millions of users. You'll lead architectural discussions, own the design of business-critical data solutions, and optimize platforms for real-time AI/ML workloads while mentoring engineers across the team.

Responsibilities

• Lead the design and delivery of robust data pipelines using GCP services including BigQuery, Dataflow, Pub/Sub and Cloud Storage, integrating data from multiple sources with real-time processing capabilities
• Own the design of data models and databases that support business analytics, applying dimensional data-modeling principles and selecting appropriate GCP database technologies (Bigtable, Spanner, Firestore) for performance and scalability
• Lead automation of data workflows and optimization of storage and processing costs within GCP, using tools such as Cloud Composer for orchestration
• Implement GCP security practices, manage access controls, and ensure compliance with data-governance policies
• Lead critical system-design and architectural decisions for scalable batch and real-time workloads
• Partner with cross-functional teams to translate complex business requirements into effective data solutions
• Mentor engineers, review technical designs, and foster a culture of continuous learning and engineering excellence
• Lead resolution of critical pipeline failures and data-quality incidents, performing fault analysis and implementing preventative improvements
• Design and maintain robust, secure integrations with core internal systems and third-party platforms
• Define monitoring and alerting standards to ensure high system reliability and minimal downtime

What We're Looking For

• Significant experience in data engineering or data warehousing with large-scale, complex datasets
• Advanced SQL and Python skills, with experience using AI-assisted development tools appropriately
• Strong knowledge of data-modeling techniques
• Deep experience with cloud data services and technologies within the GCP ecosystem, such as Dataflow, Pub/Sub, BigQuery or Vertex AI
• Proven experience designing and implementing robust ELT pipelines, including real-time and large-scale batch processing
• Proven ability to deploy and maintain data infrastructure using Infrastructure as Code principles and tools such as Terraform
• Experience with Airflow environment management and Docker
• Experience contributing to an AI roadmap and evaluating AI tooling, including coding agents, for use within the development lifecycle
• Demonstrable experience applying data-governance, privacy and security best practices in a regulated environment
• The ability to explain complex technical concepts clearly to both technical and non-technical stakeholders
• A track record of taking end-to-end ownership for the quality, reliability and performance of business-critical data solutions
• Experience mentoring engineers and influencing technical standards across a team
• A proactive and curious approach, with the ability to anticipate and resolve system inefficiencies

How We Work With You

When you apply through Get A Job.ai, our talent team will review your application and conduct an initial screening. If there's a strong match, we'll submit your profile to our client for consideration. Please do not contact the client directly—all communication and coordination will flow through our recruiting team to ensure the best experience for everyone involved.

Pay

Compensation details will be discussed during the screening process and vary based on experience level.

Equal Employment Opportunity: Get A Job.ai is committed to inclusive hiring practices and welcomes applications from candidates of all backgrounds. We evaluate all applicants based on qualifications and merit.