Lightning AI
Who We Are
Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with less friction.
Through our merger with Voltage Park, a neocloud and AI Factory, Lightning AI combines developer-first software with cost-efficient, large-scale compute. Teams get the tools they need for experimentation, training, and production inference, with security, observability, and control built in.
We serve solo researchers, startups, and large enterprises. Lightning AI operates globally with offices in New York City, San Francisco, Seattle, and London, and is backed by Coatue, Index Ventures, Bain Capital Ventures, and Firstminute.
What We’re Looking For
Lightning is looking for a Machine Learning Solutions Engineer with a focus on ML and Infrastructure to join ou Sales team in New York. As a Machine Learning Solutions Engineer, you will operate at the intersection of machine learning, distributed systems, and cloud infrastructure. You will partner with customers to design and deploy end-to-end AI systems, spanning:
- Model development and training
- GPU infrastructure and cluster design
- Distributed inference and production deployment
This role goes beyond traditional ML solutions engineering—you will act as a technical architect, helping customers make critical decisions across compute, orchestration, and system design.
The role is hybrid out of one of our hub locations (New York City, San Francisco, Seattle) with an in-office requirement of at least 2 days per week and occasional team and company offsites. We are not able to provide visa sponsorship for this role at this time.
What You’ll Do
Customer Architecture & Technical Leadership
- Partner with customers to understand ML workloads, infrastructure constraints, and scaling requirements
- Architect end-to-end solutions across:
- Data pipelines (CPU → GPU workflows)
- Distributed training (multi-node, multi-GPU)
- High-throughput inference systems
- Translate business goals (latency, cost, throughput) into technical system design decisions
GPU & Infrastructure Design
- Design and optimize workloads across GPU clusters (H100, H200, B200, etc.)
- Advise on:
- Training vs inference cluster design
- Interconnect choices (Ethernet vs Infiniband / RDMA vs Roce)
- Storage strategies (local NVMe vs networked / object storage)
- Model and optimize for:
- Tokens/sec, tokens/$
- Throughput vs latency tradeoffs
- GPU utilization and scheduling efficiency
Kubernetes & Platform Systems
- Design and support deployments on Kubernetes (EKS, GKE, on-prem clusters)
- Work with:
- GPU scheduling (time-slicing, MIG, bin-packing)
- Autoscaling and workload orchestration
- Helm-based deployments and multi-tenant environments
- Help customers balance:
- Raw Kubernetes flexibility vs platform abstraction (Lightning)
Demos, POCs, and Execution
- Build and deliver technical demos and POCs that showcase:
- Distributed training workflows
- Scalable inference endpoints
- End-to-end ML pipelines on Lightning AI
- Scope and lead POCs aligned to customer success metrics (latency, cost, reliability)
Cross-Functional Impact
- Act as the bridge between customers, product, and engineering
- Provide feedback on:
- Platform gaps in infrastructure, orchestration, and performance
- Emerging patterns in GPU usage and distributed systems
- Influence roadmap across ML workflows and infrastructure capabilities
Enablement & Thought Leadership
- Create technical content
- Architecture guides (e.g., high-throughput LLM inference systems)
- Best practices for GPU utilization and scaling
- Educate customers on modern AI infrastructure patterns
What You’ll Need
ML + Systems Expertise
- 3–6+ years experience in:
- Machine Learning / AI Engineering
- Solutions Engineering / Sales Engineering / ML Consulting
- Strong understanding of:
- Training vs inference workloads
- Model optimization (quantization, batching, caching, etc.)
GPU & Distributed Systems
- Experience working with:
- GPU clusters (NVIDIA stack preferred)
- Distributed training or inference systems
- Familiarity with:
- NCCL, CUDA, or GPU performance profiling
- Networking concepts (RDMA, Roce, Infiniband, high-throughput systems)
Kubernetes & Cloud Platforms
- Hands-on experience with:
- Kubernetes (EKS, GKE, or on-prem)
- Slurm
- Containerization (Docker)
- Exposure to:
- GPU scheduling in Kubernetes environments
- Multi-tenant or production ML deployments
Programming & Tooling
- Strong Python skills (PyTorch preferred)
- Experience building:
- ML pipelines
- APIs or inference services
- Familiarity with Lightning AI, PyTorch Lightning, or similar frameworks is a plus
Customer-Facing Excellence
- Ability to:
- Explain complex infrastructure and ML tradeoffs clearly
- Run technical discovery and uncover quantifiable success metrics
- Experience working cross-functionally with:
- Sales, product, and engineering teams
Compensation
The annual base pay range for this role is $150,000 – $195,000, in addition to a variable pay component and meaningful equity.
Benefits and Perks
We offer a comprehensive and competitive benefits package designed to support our employees’ health, well-being, and long-term success. Benefits may vary by location, team, and role.
Benefits include:
- Comprehensive medical, dental and vision coverage (U.S.); Private medical and dental insurance (U.K.)
- Retirement and financial wellness support (U.S.); Pension contribution (U.K.)
- Generous paid time off, plus holidays
- Paid parental leave
- Professional development support
- Wellness and work-from-home stipends
- Flexible work environment
At Lightning AI, we are committed to fostering an inclusive and diverse workplace. We believe that diverse teams drive innovation and create better products. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic. We are dedicated to building a culture where everyone can thrive and contribute to their fullest potential.
To apply for this job please visit job-boards.greenhouse.io.
Explore Lightning AI online
Working in New York, NY
New York, often called New York City (NYC), is the most populous city in the United States. It is located at the southern tip of New York State on New York Harbor, one of the world's largest natural harbors. The city comprises five boroughs—Manhattan, Brooklyn, Queens, the Bronx, and Staten Island; each is coextensive with its respective county. It is the geographical and demographic center of both the Northeast megalopolis and the New York metropolitan area, the largest metropolitan area in the United States by both population and urban area. New York is a global center of finance and commerc
Market context
- Similar listings in New York, New York, United States; San Francisco, California, United States; Seattle, Washington, United States 1
Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.
Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.