Senior Software Engineer – Data Platform

About This Opportunity

Our talent team is representing a confidential IoT platform organization seeking a Senior Software Engineer to join their Data Platform team. This is a critical infrastructure role building and maintaining the core analytical systems that power petabyte-scale data operations.

This is a highly technical software engineering position focused on data infrastructure—not an analytics or business intelligence role. You'll be working on distributed systems, data lake architecture, ingestion pipelines, and the foundational platform that enables AI, analytics, and product teams across the organization to operate at scale.

This is a remote position for candidates residing in the United States.

Responsibilities

In this role, you will:

• Design, build, and operate high-scale data ingestion and replication systems from production data stores including RDS, DynamoDB, internal APIs, and event-driven systems into a modern data lakehouse
• Build and maintain reliable, scalable data platform infrastructure capable of handling petabytes of data across analytics, AI, product, and operational use cases
• Improve reliability, observability, scalability, security, and developer experience of Spark and Databricks-based data processing infrastructure
• Develop internal libraries, APIs, frameworks, and tooling in Go and Python to help engineering teams move, process, discover, and access data safely and efficiently
• Work on foundational data lake and lakehouse technologies including Delta Lake on S3, data catalogs, metadata services, orchestration systems, and platform automation
• Collaborate closely with infrastructure, product engineering, data science, analytics, security, and data engineering teams to deliver durable, scalable solutions
• Stay current with modern data platform technologies and help shape the long-term data infrastructure roadmap supporting AI, privacy, security, and global scale requirements

What We're Looking For

Required qualifications:

• 4+ years of professional software engineering experience in production environments
• 4+ years building or maintaining large-scale production data infrastructure, data platforms, distributed systems, or data lake systems
• Strong hands-on experience with Apache Spark or similar distributed data processing systems
• Experience operating production infrastructure in AWS, including S3, RDS, DynamoDB, SQS, Kinesis, Lambda, or similar services
• Proven track record designing, building, and operating reliable systems with strong ownership of scalability, observability, security, and operational excellence
• Proficiency in at least one production programming language such as Go, Python, Scala, or Java
• Ability to collaborate effectively with cross-functional partners including software engineers, data scientists, analysts, security teams, and product stakeholders

Preferred qualifications:

• Experience with Databricks, Delta Lake, or similar lakehouse technologies such as Iceberg or Hudi
• Experience building data replication or ingestion systems from OLTP data stores into a data lake or lakehouse
• Experience with Infrastructure-as-Code tools such as Terraform or CloudFormation
• Familiarity with data catalogs, metadata systems, and data discovery tools such as Unity Catalog, Hive Metastore, DataHub, or Amundsen
• Experience with orchestration systems such as Airflow, Dagster, or Prefect
• Experience with streaming data, event-driven architectures, or systems handling late-arriving or mutable data
• Familiarity with containerization or orchestration technologies such as Docker, Kubernetes, ECS, or Fargate
• Experience building internal platforms, libraries, or developer tooling used by other engineering teams
• Experience contributing to data infrastructure roadmaps, evaluating new technologies, and driving improvements that create leverage for internal and external customers

How We Work With You

As your recruiting partner, Get A Job.ai manages the confidential search process for this position. When you apply through our platform at getajob.ai, one of our experienced recruiters will screen your background and qualifications. If there's a strong match, we'll submit your profile to our client for consideration and guide you through their interview process.

Please do not attempt to contact the client directly, as all communication and coordination will be handled through our recruiting team to ensure a smooth and professional experience.

Pay

The client has indicated an annual base salary range of $130,900–$220,000 USD for this position, varying based on location, experience, and qualifications. This role is also eligible for equity grants and performance-based compensation.

Get A Job.ai's fee is paid by the hiring organization.

Equal Employment Opportunity: Get A Job.ai is committed to inclusive recruiting practices. We welcome applications from candidates of all backgrounds and ensure equal opportunity throughout our process without regard to race, color, religion, national origin, sex, gender identity, sexual orientation, protected veteran status, disability, age, or other characteristics protected by law.