Sr. Software Engineer II – AI

iHerb is hiring a remote Sr. Software Engineer II – AI to spearhead the development of generative-AI product experiences and the platform that powers them. This full-time role, open to candidates across the USA, puts you at the center of how millions of shoppers discover wellness products through intelligent, AI-driven features.

About the Role

As a Sr. Software Engineer II – AI at iHerb, you will own the design and operation of production GenAI capabilities — from retrieval-augmented generation (RAG) over our product catalog and customer reviews to LLM-powered personalization, a conversational Wellness Agent, and agentic workflow automation. You will also help build the shared AI platform: retrieval infrastructure, evaluation frameworks, monitoring, guardrails, and the MLOps layer that keeps these features reliable and repeatable. Specialization tracks span RAG and personalization, agent frameworks and tool use, evals and guardrails, and LLM applications for internal functions like marketing automation and BI agents.

Key Responsibilities

• Build and operate production AI features such as RAG pipelines, LLM-driven recommendations, conversational agents, and agentic automation.
• Develop the shared AI platform layer: retrieval systems, eval frameworks, model monitoring, guardrails, and observability.
• Create LLM applications and integrations across marketing platforms, BI tools, and customer-facing surfaces.
• Measure model and feature quality with structured evals, iterating on prompts, retrieval strategies, and model selection using data.
• Apply AI-assisted SDLC tooling like Claude Code as a daily practice for both AI and non-AI work.
• Partner with the Personalization team to align GenAI features with existing ML signals, and document design decisions and lessons learned.
• Own end-to-end observability — latency, cost, quality drift, and error rates — and participate in on-call rotation and incident response.

Qualifications

• 10+ years of software engineering experience; Bachelor's in Computer Science or equivalent experience preferred.
• Hands-on, daily use of AI-assisted development tools (Claude Code, GitHub Copilot, or Cursor) to ship real production code.
• Python proficiency and experience building and operating production LLM applications.
• Depth in at least one area: RAG and retrieval, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM workflow automation.
• Solid grasp of prompt engineering, context-window management, vector databases, embeddings, and semantic search.
• Full-stack comfort, strong software design and testing fundamentals, CI/CD, and a track record of owning features end-to-end.
• Preferred: MLOps and deployment pipelines, e-commerce or high-traffic consumer platforms, distributed-team experience, and RFC/architecture documentation.

About iHerb

iHerb is a global e-commerce leader in health and wellness, serving customers worldwide with a vast catalog of natural products. Our engineering teams own what they ship, move fast, and mentor one another in a professional yet casual environment.

How to Apply

To apply, complete your application directly on this page, or you'll be redirected to the employer's application platform to finish submitting there.