AI Platform Engineer

About This Opportunity

We are representing a confidential technology consulting organization seeking an experienced AI Platform Engineer to design, build, and operate enterprise-scale AI inference and machine learning platforms. This is a 100% remote position available throughout the continental United States, offering the opportunity to work on cutting-edge AI infrastructure supporting production machine learning workloads.

This is a full-time, direct W2 position. U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. Our client is unable to sponsor new H-1B visa petitions for this role.

Responsibilities

• Design, build, and maintain scalable AI inference and model-serving platforms for enterprise production environments
• Architect highly available, cloud-native infrastructure supporting Large Language Models (LLMs), foundation models, and machine learning services
• Optimize inference latency, throughput, GPU utilization, memory management, and request scheduling across distributed AI workloads
• Design autoscaling, workload orchestration, traffic management, and intelligent request routing strategies for AI services
• Implement model deployment, versioning, rollback, and lifecycle management using modern MLOps practices
• Develop monitoring, observability, logging, distributed tracing, and alerting solutions to ensure platform reliability and performance
• Implement caching strategies, API gateways, security controls, authentication, authorization, and high-availability architectures
• Collaborate with AI researchers, ML engineers, DevOps teams, and software engineers to deploy and support production AI models
• Drive cloud infrastructure optimization, resource utilization, and operational excellence
• Mentor engineering teams, conduct architecture reviews, and establish best practices for AI platform engineering
• Evaluate emerging AI infrastructure technologies, model-serving frameworks, and GPU acceleration techniques

What We're Looking For

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Artificial Intelligence, or related technical discipline
• 10+ years of professional experience in distributed systems, infrastructure engineering, cloud platforms, or machine learning platform engineering
• Strong programming skills in Python and at least one systems programming language (Go, Rust, or C++)
• Extensive experience with Large Language Model (LLM) serving, model inference optimization, and production AI infrastructure
• Hands-on experience with vLLM, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar AI serving frameworks
• Strong expertise in Kubernetes, container orchestration, Docker, and cloud-native application architectures
• Experience optimizing GPU workloads using CUDA, NVIDIA GPU technologies, distributed inference, and high-performance AI infrastructure
• Experience with cloud platforms including AWS, Microsoft Azure, or Google Cloud Platform
• Strong understanding of distributed systems, networking, scalability, observability, and security best practices
• Excellent analytical, communication, collaboration, and technical leadership skills

Preferred Qualifications:

• Experience designing and operating multi-region AI platforms and globally distributed inference services
• Knowledge of model optimization techniques such as quantization, pruning, compression, speculative decoding, KV cache optimization, and mixed-precision inference
• Experience with MLOps, GitOps, Infrastructure as Code (Terraform, CloudFormation), and CI/CD automation
• Familiarity with service mesh technologies such as Istio or Linkerd, API gateways, and event-driven architectures
• Contributions to open-source AI infrastructure projects, technical publications, patents, or conference presentations
• Experience implementing cloud cost optimization and enterprise AI governance strategies

How We Work With You

Our talent team at Get A Job.ai partners with you throughout the entire hiring process. When you apply through our platform, one of our experienced recruiters will screen your qualifications and present your profile to our client. We manage the coordination and feedback at each interview stage. Please do not contact the client directly—all communication flows through Get A Job.ai to ensure the best candidate experience.

Pay

Pay via Get A Job.ai: $130,000–$180,000 annually, based on experience.

Equal Employment Opportunity: Get A Job.ai is committed to equal employment opportunity for all applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic under applicable law.