Lead Data Engineer (GenAI / LLM Applications)

About This Opportunity

We are representing a confidential healthcare technology organization seeking a Lead Data Engineer to join their Data Science and Delivery team. This role combines software development, data engineering, and analytical problem-solving to design, build, and maintain scalable data platforms. You will work across the full software development lifecycle, collaborating with data scientists, analysts, product managers, and engineering teams to deliver high-quality, data-driven solutions that support critical operations and business intelligence.

The position is based in India (Bangalore or remote within India) and offers the opportunity to work with cutting-edge GenAI and LLM technologies while collaborating with global teams.

Responsibilities

• Design, develop, and maintain scalable software architectures and data pipelines that integrate with analytical and operational systems
• Write clean, reusable, and well-tested Python code using frameworks such as Flask and related libraries
• Leverage AI-assisted development tools, including GitHub Copilot and LangChain, to design, build, and integrate LLM-powered solutions such as retrieval-augmented generation (RAG) pipelines, intelligent agents, and automated workflows using AWS Bedrock or similar services
• Develop and optimize complex SQL across Oracle, MS SQL Server, PostgreSQL, and Snowflake, including procedures, functions, views, analytical functions, and dynamic SQL
• Design and implement ETL pipelines using Snowflake and related data processing technologies
• Implement scheduling and orchestration using Apache Airflow or similar workflow orchestration frameworks
• Establish and maintain data quality frameworks, versioning, and governance practices to ensure data reliability, integrity, and compliance
• Develop and maintain data architectures and models for both structured and unstructured data sources
• Troubleshoot production issues and drive continuous improvement in software quality, performance, and reliability
• Deploy, manage, and support solutions on AWS, including storage, compute, and pipeline services
• Create source-to-target mappings and support data and code migration initiatives
• Partner with stakeholders to gather requirements, translate business needs into technical solutions, and produce clear, well-structured documentation
• Collaborate with product managers, analysts, and cross-functional teams to deliver data-driven insights and reporting using tools such as Plotly and Power BI

What We're Looking For

• Bachelor's or higher degree in Computer Science, Information Technology, or a related technical field
• 5+ years of professional experience in software engineering, data engineering, or data-focused development roles
• Strong proficiency in Python, including frameworks and libraries such as Django or Flask, pandas, NumPy, Plotly, and ag-Grid
• Strong SQL expertise with Oracle, MS SQL Server, PostgreSQL, and/or Snowflake
• Proven experience writing complex SQL, including analytical and window functions, subqueries, all join types, DML/DDL/TCL statements, CASE expressions, and performance tuning
• Working knowledge of cloud platforms, with a preference for AWS (S3, EC2, Secrets Manager, Bedrock, Lambda)
• Experience using AI-assisted development tools and frameworks such as GitHub Copilot and LangChain for building LLM-powered applications and workflows
• Experience with Git-based version control systems and CI/CD pipelines
• Familiarity with data modeling concepts for both structured and unstructured data
• Strong analytical thinking, problem-solving abilities, and communication skills
• Willingness to work across all phases of the SDLC, including requirements gathering, design, development, deployment, and production support

Preferred qualifications:

• Exposure to the clinical trial lifecycle or clinical data management
• Experience with data visualization tools (Plotly, Power BI)
• Front-end technologies (HTML5, CSS3, JavaScript)
• Collaboration tools (Jira, Confluence, Microsoft Teams)
• Hands-on data analysis or data cleansing using programming languages, SQL, and Excel

How We Work With You

Our talent team at Get A Job.ai partners with leading organizations to connect exceptional candidates with career-defining opportunities. When you apply through our platform, a dedicated recruiter will review your profile and schedule an initial screening to understand your background, technical expertise, and career goals. If there's a strong mutual fit, we will submit your candidacy to our client for consideration and guide you through each stage of their interview process.

Please apply exclusively through Get A Job.ai. Do not attempt to contact the client organization directly, as this may disqualify your application.

Pay

Compensation will be competitive and aligned with local market practices in India. Our client offers comprehensive health and wellness benefits, paid time off, company holidays, and strong opportunities for professional development, learning, and career growth.

Get A Job.ai is an equal opportunity recruiter. We celebrate diversity and are committed to creating an inclusive environment for all candidates, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status.