Senior Software Engineer, Data & Platform Services

About This Opportunity

We are representing a confidential conversational AI technology company seeking a Senior Software Engineer, Data & Platform Services based in Germany (fully remote). Our client operates at significant scale, processing enterprise-level conversational data and analytics globally.

This is a high-impact individual contributor role where you'll lead the modernization of critical data infrastructure, migrating legacy systems to cloud-native architectures. You'll work with a globally distributed engineering team and shape the technical foundation that powers data-driven business intelligence.

Responsibilities

• Lead Platform Modernization: Take ownership of migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a modern Databricks ecosystem. Re-architect ETL workflows, convert complex SQL, and seamlessly migrate integrations, connections, and secrets.
• Leverage AI-Powered Development: Use cutting-edge AI coding assistants (Claude, Codex, and similar tools) to accelerate migration efforts. Guide AI tools to convert SQL, modernize ETL scripts, and generate maintainable code while applying your engineering expertise to validate architecture, performance, and quality.
• Build Next-Generation Data Pipelines: Design, develop, and optimize scalable data workflows using Airflow and Databricks. Create resilient, high-performance pipelines that are reliable, cost-efficient, and built to support growing business needs.
• Champion Data Quality: Ensure accuracy and consistency of migrated data by implementing comprehensive validation and testing strategies throughout the migration journey.
• Improve Platform Reliability: Drive operational excellence by enhancing observability, monitoring, and incident response practices. Contribute to service reliability through SLOs/SLAs and participate in scalable on-call rotation to support production systems.
• Deliver Business Impact: Build platforms that power customer conversation insights, reporting, and business intelligence with a data-driven, measurable approach.

What We're Looking For

Required Qualifications:

• 6–8 years of software engineering experience building and supporting distributed systems and large-scale data platforms, with proven ability to own complex technical initiatives from design through production
• Platform Modernization Experience: Hands-on experience migrating enterprise data platforms from legacy technologies (Hadoop, Spark, Hive, Impala) to modern cloud-based solutions like Databricks
• Deep Databricks Expertise: Strong knowledge of Databricks Jobs, Delta Lake, cluster configuration/optimization, and migrating complex SQL workloads from Impala or Hive to Spark SQL
• Data Pipeline & Orchestration: Advanced Python programming for ETL development and extensive experience designing, building, debugging, and optimizing production pipelines using Airflow and Databricks
• Cloud & Infrastructure: Experience with cloud-native data platforms, particularly Google Cloud Platform (GCP) and Google Cloud Storage (GCS), with understanding of containerized, Kubernetes-based (GKE) microservice architectures
• Modern Data Platform Expertise: Strong understanding of distributed data processing architectures, trade-offs between real-time and batch processing, and data integration patterns (APIs, connectors, webhooks, event-driven architectures)
• AI-Assisted Development: Experience using AI-powered development tools (Claude, Codex, or similar) to accelerate software development, code modernization, and platform migrations. Skilled at effectively prompting, reviewing, and validating AI-generated code while ensuring architectural integrity and production readiness
• Collaboration Skills: Excellent communication and collaboration abilities, with experience partnering across engineering teams in multiple time zones (US, Europe, Israel, India)

Nice to Have:

• Experience with conversational AI, contact center platforms, or customer engagement technologies
• Proficiency in Java or Scala, particularly for analyzing and modernizing legacy codebases
• Experience designing and implementing CI/CD pipelines for automated testing and deployment

How We Work With You

When you apply through Get A Job.ai, our talent team will review your qualifications and schedule an initial screening call to discuss your background, technical experience, and career goals. We'll work closely with you to prepare your candidacy and then submit you to our client for consideration.

Important: Please apply only through Get A Job.ai. Do not contact the client organization directly, as this may disqualify your application. All communication regarding this opportunity will come from our recruiting team.

Pay

Compensation details will be discussed during the screening process based on your experience and the client's budget parameters.

Equal Opportunity: Get A Job.ai is committed to fostering an inclusive recruitment process. We welcome applications from all qualified candidates regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other protected characteristics.