AI Inference Engineer QVAC (100% remote Worldwide)

About This Opportunity

We are representing a confidential blockchain technology organization that is building the next generation of private, peer-to-peer AI infrastructure. Our talent team is searching for an AI Inference Engineer to own the C++ systems layer that powers on-device AI experiences.

In this role, you will architect and optimize the inference backbone that makes AI models run fast, reliably, and predictably on real user hardware—without relying on cloud infrastructure. You'll define core abstractions that enable new AI capabilities while maintaining production-grade performance and stability.

This is a 100% remote position open to candidates worldwide.

Responsibilities

• Design and implement the C++ runtime layer for local AI inference, working with engines like llama.cpp and ggml
• Optimize model loading, memory management, and throughput/latency balance across diverse hardware configurations
• Ensure long-session stability and predictable behavior under memory pressure
• Port and enhance inference engines to run efficiently on edge devices
• Collaborate with research teams to transition models from development to production environments
• Integrate AI features into existing products, enabling private on-device experiences
• Build infrastructure abstractions that support scalable feature development without sacrificing performance

What We're Looking For

• Excellent programming skills in C++; JavaScript experience is a bonus
• Strong hands-on experience with llama.cpp and ggml inference engines
• Deep understanding of deploying models to specific GPU architectures
• Solid grasp of deep learning concepts and model architectures
• Experience with transformers, large language models, and diffusion models
• Proven ability to quickly learn and apply new technologies and techniques
• Degree in Computer Science, AI, Machine Learning, or related field
• Track record in AI research and development or production systems
• Excellent English communication skills for remote collaboration

How We Work With You

Candidates apply directly through Get A Job.ai. Our recruiting team will conduct an initial screening to understand your background and technical experience. If there's a strong match, we will submit your profile to our client for consideration. Please do not attempt to contact the client directly, as all communication is managed through our talent team to ensure a smooth and professional process.

Pay

Compensation details will be discussed during the screening process based on experience and location.

Equal Opportunity: Get A Job.ai is committed to inclusive hiring practices. We welcome applications from candidates of all backgrounds and work to ensure fair consideration throughout the recruitment process.