Senior Data Engineer

About This Opportunity

We are representing a confidential technology organization seeking a Senior Data Engineer to join their data engineering team in India. This is a fully remote position offering the opportunity to design, build, and maintain scalable data pipelines and infrastructure on cloud platforms using modern data engineering tools.

Responsibilities

In this role, you will:

• Design and develop robust, scalable data pipelines using Azure Data Factory
• Build and optimize data processing workflows using Databricks and Apache Spark
• Implement declarative pipeline solutions using lakehouse architecture and best practices
• Write and optimize complex SQL queries for data transformation and analysis
• Develop PySpark applications for large-scale data processing
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements
• Ensure data quality, security, and compliance across all pipelines
• Monitor, troubleshoot, and optimize data pipeline performance
• Document technical solutions and maintain best practices documentation
• Mentor junior team members and contribute to team knowledge sharing

What We're Looking For

Must-Have Technical Skills:

• Azure Data Factory (ADF) – Proven experience designing and implementing data integration solutions
• Databricks – Hands-on experience with the Databricks platform and workspace management
• Apache Spark – Strong expertise in distributed data processing using Spark framework
• Lakeflow and declarative pipelines – Experience building declarative, maintainable data pipelines
• SQL – Advanced proficiency in writing optimized SQL queries for complex data transformations
• PySpark – Strong programming skills in PySpark for data processing and ETL operations

Additional Desired Qualifications:

• Experience with cloud platforms (Azure, AWS, or GCP)
• Knowledge of data warehousing concepts and modern data architecture
• Familiarity with version control systems (Git)
• Understanding of CI/CD pipelines and DevOps practices
• Experience with data quality frameworks and testing methodologies
• Knowledge of big data technologies and distributed computing

Required Experience:

• 5+ years of professional experience in data engineering or related roles
• 3+ years of hands-on experience with cloud-based data platforms
• Proven track record of designing and implementing production-grade data pipelines
• Strong problem-solving skills and attention to detail

Education:

• Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, OR equivalent professional experience

How We Work with You

Our talent team at Get A Job.ai partners with you throughout the entire process. When you apply through our platform, one of our recruiters will conduct an initial screening to understand your experience and career goals. We then submit qualified candidates to our client for consideration. Please note that direct contact with the client is not permitted during the recruitment process—all communication will flow through Get A Job.ai to ensure a smooth and professional experience.

Pay

Compensation details will be discussed with qualified candidates during the screening process.

Equal Opportunity: Get A Job.ai is committed to inclusive recruiting practices and works with clients who value diversity in their hiring.