gft
A Data Engineering PL/SR professional will design, build and maintain scalable and resilient data pipelines, working with large volumes of structured and unstructured data. The role requires experience with data engineering in distributed environments, knowledge of Apache Spark and Scala, and experience with AWS, including Glue, S3, EMR, Athena, and Redshift.
Requirements
- Experience with data engineering in distributed environments
- Knowledge of Apache Spark and Scala
- Experience with AWS (Glue, S3, EMR, Athena, Redshift etc.)
- Knowledge of data modeling, ETL/ELT and data pipelines
- Familiarity with relational and NoSQL databases
- Experience with batch and streaming processing
- Experience with Apache Kafka or Amazon MSK
- Knowledge of modernization of legacy systems
- Experience with Delta Lake, Apache Hudi or Iceberg
- Familiarity with data CI/CD (dbt, Airflow, Terraform)
Benefits
- None mentioned
Originally posted on Himalayas
To apply for this job please visit himalayas.app.
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.