Software Development Manager, LLM Inference Model Enablement, Neuron SDK

About This Opportunity

We are representing a confidential semiconductor client in the machine learning infrastructure space. They are seeking a Software Development Manager to lead their LLM Inference Model Enablement team in Monte Vista, Santa Clara County.

In this role, you will manage a team of expert AI/ML engineers focused on onboarding and optimizing state-of-the-art large language models. Your team will work on custom machine learning accelerators, ensuring LLMs run efficiently on specialized hardware through comprehensive software stack development.

Responsibilities

• Lead and grow a team of AI/ML engineers specializing in model optimization and enablement
• Drive the onboarding and optimization of open-source and proprietary large language models
• Oversee performance tuning and inference optimization for LLM workloads on custom hardware
• Collaborate with hardware teams to maximize accelerator utilization and efficiency
• Establish best practices for model deployment and SDK development
• Partner with product and engineering leadership to define roadmap priorities
• Mentor engineers on machine learning systems, compiler optimization, and performance engineering

What We're Looking For

• Proven experience managing software engineering teams, particularly in AI/ML infrastructure
• Strong background in machine learning model deployment and optimization
• Deep understanding of LLM architectures and inference optimization techniques
• Experience with hardware acceleration, compilers, or runtime systems for ML workloads
• Track record of delivering production-grade ML infrastructure and tooling
• Excellent communication skills and ability to work cross-functionally with hardware and software teams
• Bachelor's degree in Computer Science, Engineering, or related field; advanced degree preferred

How We Work With You

Candidates apply directly through Get A Job.ai. Our recruiting team will screen your application and conduct an initial interview. If there's a strong match, we will submit your profile to our client for consideration. Please do not attempt to contact the client directly, as all communications must go through our talent team to ensure a smooth process.

Pay

Compensation details will be discussed during the screening process based on experience and qualifications.

Equal Employment Opportunity: Get A Job.ai is committed to inclusive hiring practices. We welcome applications from candidates of all backgrounds and work to ensure fair consideration throughout our recruitment process.