Senior Data Engineer

About This Opportunity

We are representing a confidential sports media and gaming organization seeking a Senior Data Engineer to join their Data Team in London. This is a hybrid role requiring three days per week in their Soho office (Tuesday through Thursday). You will take a leading role in building complex, scalable data systems that power their data strategy, lead architectural discussions, and deliver high-quality solutions that serve millions of users. This position offers the opportunity to optimize data platforms for real-time AI/ML workloads, mentor engineers, and make a significant impact on the business.

Responsibilities

• Lead the design and delivery of robust data pipelines using GCP services including BigQuery, Dataflow, Pub/Sub, and Cloud Storage, integrating data from various sources with real-time processing capabilities
• Own the design of data models and databases that support business analytics, using dimensional data-modelling principles and GCP database technologies such as Bigtable, Spanner, or Firestore
• Lead automation of data workflows and optimization of data storage and processing costs within GCP using tools such as Cloud Composer for orchestration
• Ensure data security by implementing GCP security practices, managing access controls, and complying with data-governance policies
• Lead critical system-design and architectural decisions for scalable batch and real-time workloads
• Partner with cross-functional teams to translate complex business needs into effective data solutions
• Mentor engineers, review technical designs, and foster a culture of continuous learning and engineering excellence
• Own improvements to reliability, performance, and cost-effectiveness of data systems
• Lead the design and maintenance of robust, secure integrations with core internal systems and third-party platforms
• Define monitoring and alerting standards to ensure high system reliability and minimal downtime
• Lead resolution of critical pipeline failures and data-quality incidents, performing fault analysis and implementing preventative improvements

What We're Looking For

• Significant experience in data engineering or data warehousing with large-scale, complex datasets
• Advanced SQL and Python skills, with experience using AI-assisted development tools appropriately
• Strong knowledge of data-modelling techniques
• Deep experience with cloud data services and technologies, ideally within the GCP ecosystem, such as Dataflow, Pub/Sub, BigQuery, or Vertex AI
• Proven experience designing and implementing robust ELT pipelines, including real-time and large-scale batch processing
• Proven ability to deploy and maintain data infrastructure using Infrastructure as Code principles and tools such as Terraform
• Experience with Airflow environment management and Docker
• Experience contributing to an AI roadmap and evaluating AI tooling, including coding agents, for use within the development lifecycle
• Ability to explain complex technical concepts clearly to both technical and non-technical stakeholders
• Demonstrable experience applying data-governance, privacy, and security best practices in a regulated environment
• Proactive and curious approach, with ability to anticipate and resolve system inefficiencies
• Ability to lead cross-functional technical work and translate complex requirements into robust data solutions
• Track record of taking end-to-end ownership for quality, reliability, and performance of business-critical data solutions
• Experience mentoring engineers and influencing technical standards across a team

How We Work With You

When you apply through Get A Job.ai, our talent team will review your background and conduct an initial screening to understand your experience and career goals. If there's a strong match, we will submit your profile to our client for consideration. Throughout the process, we act as your advocate and guide. Please do not contact the client directly, as all communication should flow through our recruitment team to ensure the best outcome for your candidacy.

Pay

Compensation details will be discussed during the screening process based on your experience and qualifications.

Equal Employment Opportunity

Get A Job.ai is committed to fostering an inclusive recruitment process. We welcome applicants from all backgrounds and work to ensure fair consideration for every candidate.