AI Solution Architect (m/w/d)

About This Opportunity

We are representing a confidential IT services organization in Germany that is driving digital transformation in the public sector. Our talent team is seeking an AI Solution Architect to join their Customer Cluster Environment, Transportation & Energy division on a remote basis.

In this role, you will design and evolve the overall AI/ML architecture for complex enterprise environments in the cloud, with a focus on Microsoft Azure. You will combine deep expertise in ML engineering, RAG architectures, and MLOps to deliver production-ready, scalable, and secure AI solutions. You will collaborate closely with technical experts, business units, and decision-makers to successfully establish innovative AI solutions.

Responsibilities

• Design and advance the overall AI/ML architecture as an enterprise AI platform with Microsoft Azure focus
• Provide technical leadership for ML pipeline projects, particularly in training, deployment, monitoring, and drift detection
• Architect and optimize RAG solutions, including chunking, retrieval, guardrails, and context orchestration
• Define and evolve MLOps strategies including CI/CD for models, experiment tracking, and model registry
• Lead and coordinate interdisciplinary teams of ML/AI Engineers, LLM Engineers, and MLOps Engineers
• Advise internal and external stakeholders on AI architectures and present technical concepts to IT leadership and business units

What We're Looking For

• Strong experience with cloud-based AI/ML solutions, ideally on Microsoft Azure, particularly Azure Machine Learning and Azure OpenAI Service; knowledge of additional cloud and AI services is advantageous
• Hands-on experience with MLOps concepts and tools such as MLflow, Kubeflow, or Azure ML Pipelines
• Experience building RAG architectures, prompt engineering, and working with vector databases
• Knowledge of integrating and orchestrating language models, ideally with frameworks like LangChain or LlamaIndex
• Experience with CI/CD for ML applications and excellent Python skills
• Practical experience with at least two common machine learning frameworks such as scikit-learn, PyTorch, or TensorFlow
• Experience building enterprise architectures in cloud environments
• Knowledge in adjacent areas such as data platforms, containerization, container orchestration, Infrastructure as Code, and observability is beneficial (e.g., Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, or Application Insights)
• Basic understanding of AI Governance, Responsible AI, and security and data protection requirements in enterprise environments
• Multiple years of experience with ML/AI architectures or comparable technical roles in enterprise environments
• Experience in a technical leadership or architecture role is desirable
• Azure, AWS, or Google Cloud certifications are a plus
• Ideally experience in the energy sector or utilities industry and with data-driven use cases
• Excellent German language skills (C2 level) and good English proficiency

How We Work With You

Candidates apply directly through Get A Job.ai. Our recruiting team will screen your application and qualifications. If you are a strong match, we will submit your profile to our client for consideration. Please do not contact the client organization directly—all communication flows through our team to ensure a professional and coordinated process.

Pay

Compensation details will be discussed during the screening process with our recruiting team.

Equal Opportunity: Get A Job.ai is committed to inclusive recruiting practices. We welcome applications from candidates of all backgrounds and work to ensure fair consideration throughout the hiring process.