Loading...

Senior GPU Infrastructure Engineer

Hyperbolic

Who We Are

Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By aggregating computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that promise affordability and accessibility for all. As pioneers at the intersection of AI and open-source technology, we believe in an open future where AI innovation is limited only by imagination, not by access to resources. We’re looking for forward-thinking individuals who share our passion for making AI universally accessible, secure, and affordable. Join us in building a platform that empowers innovators everywhere to turn their visionary AI projects into reality.

As we prepare for growth after our Series A, our team — led by co-founders with PhDs in AI, Math, and Computer Science — is poised to redefine computing.

About the Role

We’re seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic’s GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution. This is a foundational role where you’ll be responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers. You’ll work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers.

Who You Are

  • Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows

  • Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization

  • Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation

  • Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints

  • Proficiency with API design and cloud-init for automated provisioning and configuration

  • Solid understanding of GPU architecture, CUDA, and GPU compute optimization

  • Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders

  • Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations

  • Experience building and scaling cloud infrastructure or distributed systems in production environments

Preferred Qualifications

  • Familiarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)

  • Experience with distributed storage systems such as Ceph, Weka, or VAST Data

Hyperbolic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

To apply for this job please visit jobs.ashbyhq.com.

Working in San Francisco, California

Weather right now in San Francisco, California: checking… · Local time: · Air quality: · Daylight: · UV index:

San Francisco, officially the City and County of San Francisco, is the fourth-most populous city in California and the 17th-most populous in the United States, with a population of 826,079 in 2025. Among U.S. cities with a population of 200,000 or more, San Francisco is ranked first by per capita income, second by population density, and sixth by aggregate income as of 2024. Some 4.6 million residents live in the city's metropolitan statistical area, which is the 13th-largest in the United States. Around 9.2 million live in the San Jose–San Francisco–Oakland combined statistical area, the fift

California is a U.S. state in the Western United States that lies on the Pacific Coast. It borders Oregon to the north, and Nevada and Arizona to the east; it also shares an international border with the Mexican state of Baja California to the south. With over 39 million residents across an area of 163,696 square miles (423,970 km2), it is the largest U.S. state by population and third-largest by

🇨🇦 Relocation safety for Canada: Very Safevia Warnely, CC BY 4.0

National unemployment rate in Canada: 6.9%via World Bank

Recent seismic activity: 2 earthquakes (M4.5+) within 200km in the last 6 months — largest M5.6 near 11 km N of Redwood Valley, CA. via USGS

  • Elevation 38m (125 ft)

Source: Wikipedia (state)

Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.

Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.

Add application deadline to calendar

Keep exploring on Get A Job.ai

Not quite the right fit? Your next opportunity is a click away.

Hiring instead? Post a job and reach candidates searching right now.