Lead Compute Platform Engineer

Responsibilities

We are representing a confidential martech organization seeking a Lead Compute Platform Engineer to join their Data Platform team in London. In this role, you will build and operate the data infrastructure that powers large-scale analytics and machine learning workloads, including a modern lakehouse platform processing terabytes of data daily.

Your responsibilities will include:

• Operating and implementing new features in the data processing framework and platform services
• Engaging with data scientists and engineers to improve their productivity and experience with the platform
• Identifying and implementing computational performance improvements across the stack
• Contributing patches and bug fixes to open-source projects including Spark, Iceberg, Hadoop, and Airflow
• Serving as a technical expert on Spark and Scala across the engineering organization
• Mentoring engineers through pairing, design discussions, code reviews, and knowledge-sharing sessions
• Raising the bar on code quality, reliability, and engineering best practices across the team

You will work on a Scala-based data warehouse framework designed for type-safe, testable batch jobs, and help orchestrate a dynamic compute environment running Spark on cloud infrastructure with automatic scaling and high resource utilization.

What We're Looking For

• Minimum 7 years of software engineering experience
• Degree in Computer Science, Software Engineering, Physics, Mathematics, or related field
• 2+ years of proficiency in Scala or other JVM-based languages
• Hands-on experience with Spark and/or other large-scale data processing frameworks
• Experience with Kubernetes is a plus
• Working knowledge of Amazon Web Services (EC2, S3, Athena)
• Strong interest in back-end technologies, distributed systems architecture, and continuous learning
• Analytical approach to problem-solving with pragmatic solution design
• Ability to work independently in a dynamic environment where priorities evolve
• Excellent interpersonal and communication skills with ability to discuss technical ideas constructively
• Interest in mathematics, statistics, or advertising technology is beneficial

How We Work with You

When you apply through Get A Job.ai, our talent team will review your profile and conduct an initial screening to understand your experience and career goals. If there's a strong match, we will submit your candidacy to our client for consideration. Throughout the process, we serve as your advocate and guide.

Please apply exclusively through Get A Job.ai and do not contact the client directly, as all applications are managed through our recruiting process.

Pay

The client has indicated a salary range of £100,000 - £112,000 depending on location and experience for this position.

Equal Employment Opportunity

Get A Job.ai is committed to equal employment opportunity and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic.