Parallel Computing Engineer

About This Opportunity

We are representing a confidential technology consulting client seeking an exceptionally skilled Parallel Computing Engineer to join their growing team. This is a 100% remote, full-time W2 position based in the United States, offering the chance to work on cutting-edge high-performance computing infrastructure supporting AI, machine learning, and scientific computing workloads at enterprise scale.

Our talent team is looking for a senior engineer with 10+ years of deep expertise in GPU programming, CUDA optimization, and distributed computing to lead performance optimization initiatives and mentor engineering teams.

Responsibilities

• Design, develop, and optimize high-performance CUDA kernels for AI, deep learning, and scientific computing applications
• Analyze, profile, and optimize GPU workloads using NVIDIA Nsight Systems, Nsight Compute, CUDA Profiler, and related performance analysis tools
• Optimize GPU memory management, kernel execution, multi-GPU scaling, and distributed computing performance
• Design scalable distributed training and inference architectures using NCCL, MPI, CUDA-aware communication libraries, and high-performance networking technologies
• Develop custom GPU operators and optimized kernels for PyTorch, JAX, Triton, TensorFlow, or similar AI frameworks
• Improve training and inference performance for large language models (LLMs), deep learning, and high-performance AI workloads
• Collaborate with AI researchers, ML engineers, and software architects to accelerate production AI applications
• Build automated benchmarking frameworks, performance regression testing, and optimization pipelines
• Evaluate emerging GPU technologies, programming models, and accelerator architectures to improve computational efficiency
• Mentor engineers and provide technical leadership in GPU optimization, HPC architecture, and parallel programming best practices

What We're Looking For

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or related technical discipline
• 10+ years of professional experience in GPU programming, High-Performance Computing (HPC), or parallel computing
• Expert-level proficiency in CUDA C/C++, GPU architecture, and massively parallel programming techniques
• Extensive experience with NCCL, MPI, CUDA-aware MPI, and distributed GPU communication frameworks
• Strong understanding of GPU memory hierarchy, kernel optimization, occupancy tuning, and performance analysis
• Hands-on experience integrating custom GPU kernels into PyTorch, TensorFlow, JAX, Triton, or other machine learning frameworks
• Strong C/C++ programming skills with expertise in debugging, profiling, and performance optimization
• Experience developing scalable AI or HPC solutions on cloud platforms or large GPU clusters
• Excellent analytical, communication, collaboration, and technical leadership skills
• U.S. work authorization (Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates eligible; no new H-1B sponsorship available)

Preferred Qualifications:

• Experience with Triton, CUTLASS, TensorRT, FasterTransformer, vLLM, DeepSpeed, or similar GPU optimization frameworks
• Knowledge of LLVM, MLIR, compiler optimization techniques, or code generation technologies
• Experience with large-scale distributed AI training, model parallelism, pipeline parallelism, and inference optimization
• Familiarity with cloud-based GPU infrastructure on AWS, Microsoft Azure, or Google Cloud Platform
• Contributions to open-source GPU libraries, research publications, patents, or technical presentations
• Experience with emerging accelerator technologies such as AMD ROCm or Intel architectures

How We Work with You

When you apply through Get A Job.ai, our experienced recruiting team will carefully review your qualifications and conduct an initial screening. If there's a strong match, we'll submit your profile to our client for consideration and guide you through each stage of the interview process. Please apply exclusively through Get A Job.ai—direct contact with the client is not part of this search process.

Pay

Pay via Get A Job.ai: $130,000–$180,000 annually

Equal Employment Opportunity

Get A Job.ai is committed to equal employment opportunity for all applicants regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic under applicable law.