Staff Platform Engineer, Service Infrastructure

Together AI seeks a Staff Platform Engineer to direct service infrastructure evolution within Product Foundations in San Francisco. Lead the technical vision for our mission-critical platforms and help build the infrastructure that scales across our entire organization.

The Opportunity

Product Foundations operates core systems that enable all Together AI cloud offerings—the API layer, web platform, billing and payments, and identity services. These services are essential to every customer and internal process. You'll chart the infrastructure course for Product Foundations, translating recurring technical challenges into scalable, company-wide solutions. Working closely with platform teams, you'll ensure our foundational services maintain high reliability, smooth operations, and production readiness.

Responsibilities

• Direct infrastructure strategy for Product Foundations, spanning Kubernetes cluster management, AWS cloud services, Terraform-based infrastructure configuration, content delivery networks, load balancing systems, DNS infrastructure, identity and access management, and operational best practices.
• Elevate service maturity across Product Foundations through improved stability, operational smoothness, deployment confidence, technical consistency, and production preparedness.
• Collaborate intensively with API and UI Platform teams on edge caching, domain resolution, content acceleration, request distribution, and API gateway patterns.
• Work with Infrastructure, Networking, and Security teams to integrate Product Foundations with company-wide platform standards and ensure Product Foundations requirements influence shared infrastructure.
• Advance infrastructure initiatives supporting Product Foundations, including Terraform deployment automation, Kubernetes network layers, encrypted service-to-service communication, infrastructure compliance policies, and multi-region connectivity.
• Author reusable infrastructure patterns: Helm deployment templates, Terraform modules, CI/CD automation, service initialization tooling, runbooks, and knowledge documentation.
• Crystallize technical standards through technical documentation, design evaluation, engineer mentorship, and hands-on work that enables Together to reliably scale services across teams and geographies.

Requirements

• 7+ years in infrastructure engineering, platform operations, reliability engineering, distributed systems, cloud platforms, or comparable domains.
• Production-level mastery of container systems, especially EKS, Helm package ecosystems, continuous deployment frameworks like ArgoCD and Argo Rollouts, ingress management, scale-out automation, credential handling, service identity, network configuration, and deployment strategies.
• Proficiency with infrastructure-as-code tools, specifically Terraform, including modular component design, test automation, rule-based enforcement, managed state transitions, and self-service deployment workflows.
• Hands-on experience with network infrastructure platforms such as edge caching services, layer-7 and layer-4 load balancers, DNS systems, TLS/encryption, access filtering, and traffic orchestration.
• Fluency with systems languages for infrastructure tooling—Go, Python, TypeScript, or equivalent.
• Demonstrated AWS experience, particularly with EKS, IAM frameworks, VPC networking, elastic load balancing, Route 53, CloudFront, ECR image management, and related infrastructure services.
• Applied experience with observability platforms encompassing metrics ingestion, log collection, transaction tracing, metric dashboards, alarm configuration, SLO frameworks, and response coordination.
• Track record directing multi-team initiatives spanning product engineering, infrastructure teams, network operations, and security organizations.
• Clear technical writing with skill in specifications, implementation strategies, operations playbooks, and standards documentation.
• Staff-level engineering capability: untangle ambiguous technical problems, navigate tradeoffs thoughtfully, lead through influence, improve systems and people.

Why Join Together AI

Together AI advances artificial intelligence through open, transparent approaches that drive innovation and create positive impact. We're systematically reducing AI infrastructure expenses through integrated development of software, hardware, models, and algorithms. Our research team has published and open-sourced transformative work including FlashAttention, Hyena, FlexGen, and RedPajama. Work with leading researchers and engineers building the foundation of next-generation AI systems.

Apply Today

To apply, complete your application directly on this page, or you'll be redirected to the employer's application platform to finish submitting there.