Azure Data Engineer II – Agentic AI Platform

Azure Data Engineer II - Agentic AI Platform at paiqo GmbH in job, Full Time position.

What This Role Involves

The role of an Azure Data Engineer II involves shaping the future with scalable and secure data platforms using Azure technologies. You will be responsible for designing complex data pipelines that span from zero-ETL replication to Delta Lake-based lakehouses, ensuring robust batch and streaming pipelines with tools like Azure Data Factory, MS Fabric, and Databricks.

Core Duties

• Plan, develop, and maintain advanced batch and streaming data pipelines using Azure Data Factory, MS Fabric, and Databricks.
• Integrate new Azure features such as mirroring (zero ETL), Delta Live Tables, and Unity Catalog for centralized governance.
• Automate deployments and testing with CI/CD tools like Azure DevOps or GitHub Actions and infrastructure as code using Bicep/Terraform.
• Ensure data quality, lineage, and security by leveraging Microsoft Purview and role-based access control.
• Collaborate with data scientists, product owners, and customers to translate requirements into scalable data solutions.

Qualifications

• Experience in designing and implementing complex data pipelines using Azure Data Factory, MS Fabric, and Databricks.
• Familiarity with zero-ETL replication techniques and Delta Lake-based lakehouses.
• A strong understanding of CI/CD practices and infrastructure as code tools like Bicep/Terraform.
• Knowledge in data quality, lineage, and security best practices using Microsoft Purview.
• Excellent communication skills to collaborate with cross-functional teams.

Why Join paiqo GmbH

Join a company that values innovation and inclusivity. At paiqo, you will have the flexibility to work from anywhere in Germany or remotely, trust-based working hours, and hybrid working options. Our state-of-the-art technology stack includes Fabric, Delta Lake, Databricks, and mirroring, perfect for tech-savvy professionals. We offer targeted further training opportunities, an innovation space to test new tools, and the chance to make real influence on our technology decisions.

Apply Today

To apply, complete your application directly on this page, or you'll be redirected to the employer's application platform to finish submitting there. We look forward to your application!