AI Solution Architect (m/w/d)

About This Opportunity

We are representing a confidential IT services organization in the public sector space. Our talent team is seeking an AI Solution Architect to design and implement enterprise-grade AI/ML architectures in cloud environments. This is a remote position based in Germany, requiring full professional fluency in German (C2 level).

In this role, you will architect scalable, production-ready AI solutions with a focus on Microsoft Azure, leading cross-functional teams and working closely with stakeholders to establish innovative AI platforms.

Responsibilities

• Design and evolve enterprise AI/ML architecture platforms with emphasis on Microsoft Azure infrastructure
• Lead technical implementation of ML pipeline projects covering training, deployment, monitoring, and drift detection
• Architect and optimize RAG (Retrieval-Augmented Generation) systems including chunking strategies, retrieval mechanisms, guardrails, and context orchestration
• Define and advance MLOps strategies encompassing CI/CD for models, experiment tracking, and model registry management
• Provide technical leadership and coordination for interdisciplinary teams including ML/AI Engineers, LLM Engineers, and MLOps Engineers
• Advise internal and external stakeholders on AI architectures and present technical concepts to IT leadership and business units

What We're Looking For

• Substantial experience with cloud-based AI/ML solutions, ideally on Microsoft Azure (Azure Machine Learning, Azure OpenAI Service); knowledge of additional cloud AI services is advantageous
• Hands-on experience with MLOps concepts and tools such as MLflow, Kubeflow, or Azure ML Pipelines
• Proven experience building RAG architectures, prompt engineering, and working with vector databases
• Knowledge of language model integration and orchestration, preferably with frameworks like LangChain or LlamaIndex
• Experience with CI/CD for ML applications and strong Python skills
• Practical experience with at least two major machine learning frameworks (scikit-learn, PyTorch, TensorFlow)
• Experience building enterprise architectures in cloud environments
• Familiarity with adjacent areas such as data platforms, containerization, container orchestration, Infrastructure as Code, and observability tools (Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, Application Insights) is beneficial
• Foundational understanding of AI Governance, Responsible AI, and security/privacy requirements in enterprise contexts
• Several years of experience with ML/AI architectures or comparable technical roles in enterprise environments
• Experience in a technical leadership or architecture role is desirable
• Azure, AWS, or Google Cloud certifications are a plus
• Experience in the energy sector or utilities industry and with data-driven use cases is ideal
• Excellent German language skills (C2 level) and good English proficiency required

How We Work with You

Candidates apply directly through Get A Job.ai. Our recruiting team will conduct an initial screening to understand your background and career goals. Once we determine mutual fit, we will submit your profile to our client for consideration. Please do not contact the client organization directly—all communication flows through Get A Job.ai to ensure a smooth, professional process.

Pay

Compensation details will be discussed during the screening process based on experience and qualifications.

Equal Opportunity: Get A Job.ai is committed to inclusive recruiting practices. We welcome applications from all qualified candidates regardless of background.