Senior Data Engineer – Real time analytics

About This Opportunity

We are representing a fast-growing, AI-powered communications platform in their search for a Senior Data Engineer to join their Analytics & Data Platform team in London. Our client serves thousands of customers globally, and this role will be instrumental in building scalable, real-time analytics solutions that unlock data value for their user base.

This is an excellent opportunity to work on challenging data problems at scale, utilizing modern streaming architectures and cloud-native technologies in a dynamic, product-driven environment.

Responsibilities

• Design and deliver scalable, low-latency streaming platform solutions to provide near real-time data capabilities for production systems
• Analyze and translate business requirements into optimized data models for big data processing
• Identify performance bottlenecks and optimize queries for improved efficiency
• Write clean, scalable code using Scala, Python, and SQL; test and deploy applications to production
• Solve complex data challenges in near real-time using optimal architectures, frameworks, and query techniques across structured and unstructured data sources
• Contribute to engineering excellence through high-quality, secure, and scalable solution delivery
• Participate in product and platform performance optimization and production monitoring
• Mentor team members through actionable feedback and knowledge sharing

What We're Looking For

• Bachelor's degree in a technical field (Computer Science, Mathematics, or related discipline)
• 3+ years of experience with near real-time analytics systems
• 5+ years of experience with modern programming languages such as Scala, Python, Go, or TypeScript
• Proven experience designing complex data processing pipelines
• Strong background in data modeling (star schema, dimensional modeling) in AWS Redshift
• Demonstrated expertise in query optimization
• Experience with Kafka is a plus
• Track record of shipping and maintaining production code
• Collaborative mindset with a passion for sharing ideas and learning from others

Technical environment: AWS (Kinesis, Kafka, S3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink, Airflow, GitLab-based continuous deployment

How We Work With You

Candidates apply directly through Get A Job.ai. Our talent team conducts an initial screening to understand your experience and career goals. We then submit qualified candidates to our client for consideration. Please do not contact the client directly—all communication and coordination happens through our recruitment team to ensure a smooth, professional process.

Pay

Compensation details will be discussed during the screening process and are competitive with market rates for senior data engineering roles in London.

Equal Opportunity: Get A Job.ai is committed to inclusive recruiting practices. We welcome applications from candidates of all backgrounds and work to ensure equitable access to opportunities.