- Full Time
- San Francisco
Inferact
Inferact’s mission is to grow vLLM as the world’s AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We’re looking for an infrastructure engineer to build the distributed systems that power inference at global scale. You’ll design and implement the foundational layers that enable vLLM to serve models across thousands of accelerators with minimal latency and maximum reliability. Tomorrow, deploying a frontier model at scale should be as straightforward as spinning up a serverless database. The complexity doesn’t disappear as it gets absorbed into the infrastructure you’re building.
Skills and Qualifications
Minimum qualifications:
-
Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
-
Strong systems programming skills in Rust, Go, or C++.
-
Experience designing and building high-performance distributed systems at scale.
-
Understanding of network protocols and high-performance I/O.
-
Ability to debug complex distributed systems issues.
Preferred qualifications:
-
Experience with ML serving infrastructure and disaggregated inference architecture.
-
Familiarity with GPU programming models and memory hierarchies.
-
Knowledge of GPU interconnects (NVLink, InfiniBand, RoCE) and their performance characteristics.
-
Track record of improving system reliability and performance at scale.
Bonus points if you have:
-
Prior experience in supporting large‑scale model training or inference environments.
Logistics
-
Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
-
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 – $400,000 USD + equity.
-
Visa sponsorship: We sponsor visas on a case-by-case basis.
-
Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
To apply for this job please visit jobs.ashbyhq.com.
Terms used in this posting
- equity
- Ownership stake in the company, usually in the form of stock options or RSUs, offered in addition to salary.
Explore Inferact online
Working in San Francisco, California
Weather right now in San Francisco, California: checking… · Local time: · Air quality: · Daylight: · UV index: · Wind:
San Francisco, officially the City and County of San Francisco, is the fourth-most populous city in California and the 17th-most populous in the United States, with a population of 826,079 in 2025. Among U.S. cities with a population of 200,000 or more, San Francisco is ranked first by per capita income, second by population density, and sixth by aggregate income as of 2024. Some 4.6 million residents live in the city's metropolitan statistical area, which is the 13th-largest in the United States. Around 9.2 million live in the San Jose–San Francisco–Oakland combined statistical area, the fift
California is a U.S. state in the Western United States that lies on the Pacific Coast. It borders Oregon to the north, and Nevada and Arizona to the east; it also shares an international border with the Mexican state of Baja California to the south. With over 39 million residents across an area of 163,696 square miles (423,970 km2), it is the largest U.S. state by population and third-largest by
🇺🇸 Relocation safety for US: Exercise Normal Caution — via Warnely, CC BY 4.0
National unemployment rate in US: 4.2% — via World Bank
Recent seismic activity: 2 earthquakes (M4.5+) within 200km in the last 6 months — largest M5.6 near 11 km N of Redwood Valley, CA. via USGS
- Elevation 38m (125 ft)
Source: Wikipedia (state)
Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.
Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.