Data Engineering Architect

Tasks:

• Acting as a Senior Consultant/Solution Advisor:
• Technology partner: Advise on designing data architectures in Microsoft Azure.
• Empowering customer to spot and leverage business opportunities by unlocking the power of data.
• Providing technical and problem-solving expertise for client representatives and Lingaro project teams.
• Data Integration: Lead data integration efforts, including ETL processes, to ensure seamless data flow.
• Cloud Services Utilization: Leverage Azure, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions.
• Advise on security measures and compliance standards in cloud environments.
• Continuously monitor and optimize data solutions for cost-efficiency.
• Data Governance: Advise data governance and quality standards.
• Collaboration: Work with cross-functional teams to understand requirements and provide data solutions.
• Mentoring junior team members in cloud data architecture best practices.
• Daily tasks including:
• implementing data ingestion pipelines from multiple data sources using Azure Data Factory, Azure Databricks and other ETL tools.
• developing scalable and re-usable, self-service frameworks for data ingestion and processing.
• designing, building, and managing SQL server databases in the Azure cloud.
• performing data modelling and integrating data from various systems
• reviewing and implementing best practices for data manipulation
• creating and supporting Azure Data Factory pipelines.
• Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data.

What we are looking for:

• 11+ years of professional experience in the Data & Analytics area,
• 5+ years of experience in the Senior Consultant role with a strong focus on Azure data solutions.
• Advanced knowledge and understanding of architecture, application design, systems engineering, and integration.
• Very good knowledge of cloud data services, data warehousing, big data technologies, and data lakes. Especially Azure, DataBricks
• Expertise in data modeling, data integration, and ETL processes.
• Proven experience in using of Microsoft ETL tools (Azure Databricks, Azure Data Factory, Data Lake and SSIS)
• Databricks Unity Catalog, Asset Bundles, Data Factory, Microsoft Fabric. Logic App, Function App.
• Programming skills for data analysis (especially PySpark, SparkSQL, Python, SQL)
• Familiarity with data governance, data security, and compliance standards.
• Familiarity with agile methodologies and the ability to apply DevOps and DataOps principles to data pipelines.
• Ability to use ARM templates
• Experience in working with JSON
• Good understanding of business processes and the ability to drive automation through effective management.
• This role involves designing the project architecture. Setup, monitoring Internal Developer Platform. UC migration. Building Databricks Asset Bundles. PR reviews. Data Model / Semantic Layer setup. Model QA automation.

What we offer:

• Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
• “Office as an option” model. You can choose to work remotely or in the office, depending on your location.
• Flexibility regarding working hours and your preferred form of contract.
• Comprehensive online onboarding program with a “Buddy” from day 1.
• Cooperation with top-tier engineers and experts.
• Unlimited access to the Udemy learning platform from day 1.
• Certificate training programs. Lingarians earn 500+ technology certificates yearly.
• Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
• Internal Gallup Certified Strengths Coach to support your growth.
• Grow as we grow as a company. 76% of our managers are internal promotions.
• A diverse, inclusive, and values-driven community.
• Autonomy to choose the way you work. We trust your ideas.
• Create our community together. Refer your friends to receive bonuses.
• Activities to support your well-being and health.
• Plenty of opportunities to donate to charities and support the environment.
• Modern office equipment. Purchased for you or available to borrow, depending on your location

Originally posted on Himalayas