Madiff
This is a remote position.
Main Responsibilities
-
Design, build, and monitorETL pipelinesusingAzureandSpark technologies
-
Implement scalable, cloud-nativedata processing workflowsusingPySpark
-
Configure and operate core Azure services:Databricks,Azure Data Factory,Azure Data Lake Storage, andAzure Functions
-
Collaborate closely with analysts, data scientists, and software engineers to deliver robust data solutions
-
Translate business needs into reliable and secure data products
-
Ensure data quality, governance, and performance best practices across solutions
Design, build, and monitorETL pipelinesusingAzureandSpark technologies
Implement scalable, cloud-nativedata processing workflowsusingPySpark
Configure and operate core Azure services:Databricks,Azure Data Factory,Azure Data Lake Storage, andAzure Functions
Collaborate closely with analysts, data scientists, and software engineers to deliver robust data solutions
Translate business needs into reliable and secure data products
Ensure data quality, governance, and performance best practices across solutions
Requirements
-
At least4 yearsof professional experience indata engineering
-
Proven experience withlarge-scale data processing and transformation pipelines
-
Hands-on knowledge ofAzureor other majorcloud platforms
-
Solid coding skills inPython(especially pandas/numpy) andSQL
-
Familiarity withGit workflowsin a collaborative development setting
-
Fluency inPolishandEnglish(C1 minimumlevel in English required)
Nice to Have
-
Experience withLinux/Bash scripting
-
Familiarity withDockerorKubernetes
-
Domain experience inretail,financial services,energy, or thepublic sector
Experience withLinux/Bash scripting
Familiarity withDockerorKubernetes
Domain experience inretail,financial services,energy, or thepublic sector
Benefits
- Solid, competitive salary.
- Work in multilingual, multinational and multicultural environment on international projects
- Medical care
Originally posted on Himalayas
To apply for this job please visit himalayas.app.
About this role & career path
Working in United States
The United States of America (USA), also known as the United States (U.S.) or America, is a country primarily located in North America. It is a federal republic consisting of 50 states and a federal capital district, Washington, D.C. The 48 contiguous states border Canada to the north and Mexico to the south, with the semi-exclave of Alaska in the northwest and the archipelago of Hawaii in the Pacific Ocean. The United States also asserts sovereignty over five major island territories and various uninhabited islands in Oceania and the Caribbean. It is a megadiverse country, with the world's th
More jobs at Madiff
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.