AI Platform Engineer

About This Role

We are representing a confidential software holding company in their search for an AI Platform Engineer based in Cologne. Our client operates a portfolio of mission-critical software businesses across Europe and is building a centralized AI infrastructure platform that serves their entire organization.

As part of the AI Core team, you will own the infrastructure and deployment tooling that powers AI adoption across 50+ companies. Your primary focus will be maintaining and evolving their AI Hub platform (Open WebUI), building integrations, managing releases, and enabling distributed platform administrators to run their own instances safely and effectively.

Responsibilities

• Build and maintain platform infrastructure including container images, infrastructure-as-code, deployment tooling, and security patches for the AI Hub product used across the portfolio
• Qualify and validate upstream releases: assess database migrations, breaking changes, and patch compatibility; validate on canary environments and publish qualified releases with clear deployment notes
• Manage shared infrastructure components including Application Gateway, WAF policies, TLS certificates, Redis, DNS, and network peering that serve all portfolio companies
• Provide L2 technical support and guidance to the distributed network of L1 platform administrators; create developer guides, run onboarding sessions, and build preflight checks and guardrails
• Steward the Integrations Catalog: maintain versioned artifacts (tools, skills, agents, integrations) with user and developer documentation
• Implement fleet observability: reporting and alerting on version parity, uptime, cloud spend, and deployment status across all companies
• Own the evaluation service including the service itself, quality of judges and generators, and measurement methodology for agent performance
• Gather operational signals from production deployments and drive continuous improvement cycles

What We're Looking For

Required:

• At least 2 years of professional experience in platform engineering, DevOps, SRE, or cloud operations with ownership of production systems that others depend on
• Production cloud experience on Azure or AWS
• Infrastructure as Code experience in production: Bicep, Terraform, CDK, or CloudFormation
• Strong Python skills beyond scripting: building and maintaining small production services, working with APIs, and navigating unfamiliar codebases
• Comfortable with Linux, Docker, Git, and CI/CD as everyday working tools
• Working knowledge of databases and identity: PostgreSQL in production, and OAuth/SSO/Entra ID concepts
• AI-native mindset: actively using LLMs as tools, understanding their operational properties, and having shipped something with them
• Fluent English (primary working language); conversational German is a plus

Bonus:

• Clear technical writing skills with experience creating documentation that enables other teams
• Experience building internal platforms or tooling used by other engineering teams
• Experience working in multi-tenant or multi-customer cloud environments
• Contributions to open-source projects or maintaining a modified fork in production
• Practical experience with LLM frameworks, agents, MCP, or RAG systems in production
• French language skills

How We Work With You

Get A Job.ai partners with leading employers to connect exceptional talent with high-impact roles. When you apply through our platform, our recruiting team will review your background and conduct an initial screen. If there's a strong match, we will submit your profile to our client for consideration. Please do not contact the employer directly—all communication and coordination will go through Get A Job.ai to ensure the best experience for everyone involved.

This is a permanent, full-time position with remote-first flexibility and the option to work from the Cologne office. Our client offers a small, high-ownership team environment where decisions move quickly and your work ships to production. You'll have a direct line to leadership and clear opportunities for growth including talent reviews, events, and conference attendance.

Pay

Compensation details will be discussed during the screening process based on your experience and qualifications.

Equal Opportunity: Get A Job.ai is committed to inclusive hiring practices. We welcome applications from candidates of all backgrounds and work with our clients to ensure fair and equitable recruitment processes.