Loading...

GenAI Platform / LLM Inference Optimization Engineer (Cloud)

  • Company: Infosys
  • Location: Charlotte, Mecklenburg County

Infosys at a glance

infosys.com
  • Founded 1981
  • Employees 193383

SEC filings mentioning "Infosys": 1,224search EDGAR

Source: Wikipedia

Join Infosys as a GenAI Platform and LLM Inference Optimization Engineer (Cloud) in our Charlotte, Mecklenburg County location. We're seeking a talented engineer to drive the performance and scalability of our large language model systems on cloud infrastructure.

About the Role

As a GenAI Platform and LLM Inference Optimization Engineer, you'll own the optimization and deployment of generative AI models across cloud platforms. This full-time position bridges infrastructure engineering and machine learning, requiring deep expertise in inference performance tuning, model serving architectures, and cloud-native technologies.

What You'll Do

  • Design and optimize inference pipelines for large language models on cloud platforms, reducing latency and operational costs
  • Profile and benchmark LLM performance across different hardware configurations and cloud providers
  • Implement caching strategies, batch processing, and load balancing solutions for GenAI workloads
  • Collaborate with data science and platform teams to ensure models are production-ready and scalable
  • Troubleshoot performance bottlenecks and implement system-level improvements
  • Work with containerization, orchestration, and cloud services to deploy and maintain GenAI applications

What We're Looking For

  • Strong foundation in cloud platforms (AWS, Azure, or Google Cloud) and containerization technologies
  • Demonstrated experience optimizing machine learning models for inference or working with LLM serving frameworks
  • Proficiency in Python and C++ or similar systems-level languages
  • Understanding of model quantization, pruning, and other optimization techniques
  • Experience with distributed systems, GPU programming, or inference serving infrastructure
  • Problem-solving mindset with strong communication and collaboration skills

About Infosys

Infosys is a global leader in digital transformation and consulting. We help enterprises harness technology to solve complex business challenges while building innovative generative AI solutions.

How to Apply

To apply, complete your application directly on this page, or you'll be redirected to the employer's application platform to finish submitting there.

To apply for this job please visit www.adzuna.com.

What people say about Infosys

Recent news

Aggregated from public discussions and news; opinions are the authors’ own.

Working in Charlotte, Mecklenburg County

Weather right now in Charlotte, Mecklenburg County: checking… · Local time: · Air quality: · Daylight: · UV index: · Wind:

North Carolina is a state in the Southeastern and South Atlantic regions of the United States. It is bordered by Virginia to the north, the Atlantic Ocean to the east, South Carolina to the south, Georgia to the southwest, and Tennessee to the west. The state is the 28th-largest and ninth-most populous of the United States. Along with South Carolina, it makes up the Carolinas region of the East Co

Nearby history: Independence Building, listed 1978 (44m away) — via National Register of Historic Places

Typical climate: average high 72°F / low 49°F year-round (summers around 88°F, winters around 31°F) — via NOAA 1991-2020 Normals

  • Elevation 279m (915 ft)

Source: Wikipedia (state)

Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.

Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.

Add application deadline to calendar

Keep exploring on Get A Job.ai

Not quite the right fit? Your next opportunity is a click away.

Hiring instead? Post a job and reach candidates searching right now.

GenAI Platform / LLM Inference Optimization Engi… Infosys
Apply on company site