Senior Software Engineer, Data & Platform Services

Responsibilities

We are representing a confidential conversational AI organization seeking a Senior Software Engineer, Data & Platform Services for their Berlin-based team. This fully remote role offers the opportunity to lead the modernization of a mission-critical data ecosystem.

In this high-impact individual contributor position, you will:

• Lead platform modernization efforts: Take ownership of migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a modern, scalable Databricks ecosystem. You'll re-architect ETL workflows, convert complex SQL, and seamlessly migrate integrations, connections, and secrets.
• Accelerate development with AI-powered tools: Leverage cutting-edge AI coding assistants such as Claude and Codex to dramatically accelerate migration efforts. Guide AI tools to convert SQL, modernize ETL scripts, and generate clean, maintainable code while applying your engineering expertise to validate architecture, performance, and quality.
• Build next-generation data pipelines: Design, develop, and optimize scalable data workflows using Airflow and Databricks. Create resilient, high-performance pipelines that are reliable, cost-efficient, and built to support growing business needs.
• Champion data quality: Ensure the accuracy and consistency of migrated data by implementing comprehensive validation and testing strategies throughout the migration journey.
• Improve platform reliability: Drive operational excellence by enhancing observability, monitoring, and incident response practices. Contribute to service reliability through SLOs/SLAs and participate in a scalable on-call rotation.
• Deliver business impact: Build platforms that power customer conversation insights, reporting, and business intelligence with a data-driven mindset focused on measurable, observable, and continuously improving systems.

What We're Looking For

Required qualifications:

• 6–8 years of software engineering experience building and supporting distributed systems and large-scale data platforms, with proven ability to own complex technical initiatives from design through production.
• Platform modernization experience: Hands-on experience leading or playing a key role in migrating enterprise data platforms from legacy technologies such as Hadoop, Spark, Hive, or Impala to modern cloud-based solutions like Databricks.
• Deep Databricks expertise: Strong knowledge of the Databricks ecosystem, including Jobs, Delta Lake, cluster configuration and optimization, and migrating complex SQL workloads from Impala or Hive to Spark SQL.
• Data pipeline and orchestration skills: Advanced Python programming skills for ETL development and extensive experience designing, building, debugging, and optimizing production data pipelines and orchestration workflows using Airflow and Databricks.
• Cloud and infrastructure knowledge: Experience working with cloud-native data platforms, particularly Google Cloud Platform (GCP) and Google Cloud Storage (GCS), with understanding of containerized, Kubernetes-based microservice architectures.
• Modern data platform expertise: Strong understanding of distributed data processing architectures, trade-offs between real-time and batch processing, and hands-on experience with legacy big data technologies including Hadoop and MapReduce.
• AI-assisted development: Experience using AI-powered development tools such as Claude, Codex, or similar coding assistants to accelerate software development, code modernization, and platform migrations. Skilled at effectively prompting, reviewing, and validating AI-generated code.
• Collaboration skills: Excellent communication and collaboration skills, with experience partnering across engineering teams in multiple time zones and working in globally distributed environments.

Nice to have:

• Experience working with conversational AI, contact center platforms, or customer engagement technologies
• Proficiency in Java or Scala, particularly when analyzing, maintaining, or modernizing legacy codebases during platform migrations
• Experience designing, implementing, and maintaining CI/CD pipelines to support automated testing, deployment, and reliable software delivery

How We Work With You

Our talent team at Get A Job.ai will guide you through the entire process. When you apply through our platform, a dedicated recruiter will conduct an initial screening to understand your experience and career goals. We'll then submit qualified candidates to our client for consideration. Please note that direct contact with the client outside of our process is not permitted, as we manage all candidate communications and negotiations on your behalf.

This is a fully remote position based in Berlin, Germany. The role requires availability to collaborate with globally distributed teams across multiple time zones.

Pay

Compensation details will be discussed with qualified candidates during the screening process with Get A Job.ai.

Equal Opportunity: Get A Job.ai is committed to fostering an inclusive recruitment process. We welcome applications from all qualified candidates regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other protected characteristics.