Senior ML Engineer (Token Factory)

About This Opportunity

We are representing a confidential cloud infrastructure organization that is building advanced AI platform capabilities at massive scale. Our client operates one of the world's largest GPU clouds and is seeking a Senior ML Engineer to join their inference and fine-tuning platform team.

This is a remote position where you'll work on cutting-edge foundation model optimization, training efficiency, and production deployment challenges across text, vision, audio, and multimodal architectures.

Responsibilities

You'll contribute to several high-impact technical directions:

• Advanced Fine-Tuning: Enhance fine-tuning methodologies (both LoRA-based and full-parameter) for state-of-the-art large language models, focusing on model quality and training efficiency improvements
• Inference Optimization: Identify and resolve LLM inference bottlenecks to drive production speedups by building model training and evaluation pipelines in JAX for speculative decoding, experimenting with different architectures (dense/MoE, auto-regressive/parallel), and deriving scaling laws to guide resource allocation
• Low Precision Training & Inference: Investigate and implement low-precision methodologies (FP8, NVFP4/MXFP4) for supervised fine-tuning and reinforcement learning, optimized for modern hardware across both inference and training workflows

What We're Looking For

Required qualifications:

• Profound understanding of theoretical foundations of machine learning and reinforcement learning
• Deep expertise in modern deep learning for language processing and generation
• Experience training large models on multiple computational nodes
• Solid understanding of performance aspects of large neural network training (sharding strategies, custom kernels, hardware features)
• Strong software engineering skills with Python
• Deep experience with modern deep learning frameworks (our client uses JAX)
• Proficiency in contemporary software engineering approaches including CI/CD, version control, and unit testing
• Strong communication and leadership abilities

Preferred experience:

• Previous experience working with language models or similar NLP technologies
• Familiarity with important concepts in the LLM space such as MHA, RoPE, ZeRO/FSDP, Flash Attention, and quantization
• Track record of building and delivering products in dynamic, fast-paced environments
• Experience developing large distributed systems or high-load web services
• Open-source projects that demonstrate your engineering capabilities
• Excellent English language skills with superior written and verbal communication abilities

How We Work With You

Get A Job.ai represents top talent to leading organizations in the AI and cloud infrastructure space. When you apply through our platform:

• Our recruiting team will review your application and schedule an initial screening conversation
• We'll discuss your background, technical expertise, and career goals in detail
• If there's a strong match, we'll submit your profile to our client for consideration
• We'll guide you through the interview process and provide coaching at each stage
• Please do not contact the client directly—all communication should flow through Get A Job.ai to ensure the best candidate experience

Pay

Compensation details will be discussed during the screening process and are competitive for senior ML engineering roles at scale-focused AI infrastructure organizations.

Equal Employment Opportunity: Get A Job.ai is committed to providing equal employment opportunities to all applicants regardless of race, color, religion, sex, national origin, age, disability, or any other characteristic protected by law.