Sales Consulting
The Senior Data Engineer will design, build, and optimize large-scale data infrastructure, ensuring efficient data collection, processing, and availability to support advanced analytics and data-driven decision-making.
Role description:
- Design ETL/ELT pipelines for network telemetry data
- Interface with on-premises data collection systems
- Implement Iceberg table structures, also for time-series data
• Optimize data processing for analytics
• Manage data quality and lineage
• Implement pipeline observability
- Implement modern data protection strategies
Qualifications:
- 5+ years experience with AWS Glue, S3, Athena, IAM, Lakeformation, Lambda, S3 Tables
- Apache Iceberg and lakehouse architectures
- Java (Python, Scala) for data processing
- Familiarity with data formats (JSON, Avro, Parquet)
• Time-series database queires
- Data processing (Spark, DuckDB, Flink, AirFlow, Prefect)
• Graph Theory
• Excellent SQL Knowledge
• English: B1
Nice to have:
• AWS Certifications
Originally posted on Himalayas
To apply for this job please visit himalayas.app.
Working in United States
The United States of America (USA), also known as the United States (U.S.) or America, is a country primarily located in North America. It is a federal republic consisting of 50 states and a federal capital district, Washington, D.C. The 48 contiguous states border Canada to the north and Mexico to the south, with the semi-exclave of Alaska in the northwest and the archipelago of Hawaii in the Pacific Ocean. The United States also asserts sovereignty over five major island territories and various uninhabited islands in Oceania and the Caribbean. It is a megadiverse country, with the world's th
More jobs at Sales Consulting
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.