Data Engineer (Elasticsearch + Datawarehousing)

About This Opportunity

We are representing a confidential technology consultancy that delivers data solutions for clients across multiple industries. They are seeking a Data Engineer with deep expertise in Elasticsearch and data warehousing to join their India-based team. This role offers the opportunity to work on diverse client projects, building end-to-end data infrastructure and solving complex data challenges in a collaborative environment.

Responsibilities

• Design, implement, and optimize Elasticsearch clusters for high-performance querying and data retrieval
• Build and manage Elasticsearch indexes, ensuring efficient data storage, indexing, and query performance
• Develop and optimize data storage solutions including data lakes and warehouses
• Integrate structured and unstructured data from various internal and external systems to create unified views for analysis
• Ensure data accuracy, consistency, and completeness through validation, cleansing, and transformation processes
• Collaborate with product managers and stakeholders to translate business requirements into technical solutions
• Participate in Agile development processes including sprint planning, daily stand-ups, and sprint reviews
• Conduct thorough testing and debugging, including unit and integration tests
• Maintain comprehensive documentation for data processes, tools, and systems
• Develop APIs, microservices, and automation scripts as needed

What We're Looking For

• Bachelor's degree in Computer Science, Engineering, or related field
• Minimum 3 years of proven experience as a Data Engineer
• Strong proficiency in Elasticsearch and Python programming (required)
• Experience with SQL databases (MySQL, PostgreSQL) and NoSQL databases (MongoDB)
• Hands-on experience with Flask, API frameworks, data warehousing/lakehouse architectures, and ORM technologies
• Proficiency with data analysis tools: Databricks, Pandas, Spark, PySpark
• Experience with Java for backend systems, particularly for Elasticsearch and database integration
• Knowledge of Python utilities and tools: logging, requests, subprocess, regex, pytest
• Familiarity with ELK stack, Redis, and distributed task queues
• Understanding of data warehousing principles and concurrent/parallel processing concepts
• Experience with at least one cloud platform (Azure, AWS, or GCP) for data engineering
• Proficiency with Git version control and collaborative development workflows
• Competence working on Linux OS and creating shell scripts
• Strong problem-solving and analytical skills with attention to detail
• Excellent written and verbal communication skills
• Adaptability and willingness to learn new technologies

How We Work With You

Our talent team at Get A Job.ai partners with leading organizations to connect exceptional candidates with meaningful opportunities. When you apply through our platform, a dedicated recruiter will screen your qualifications and experience. If there's a strong match, we will submit your profile to our client for consideration. Please note that direct contact with the client is not appropriate during this process—all communication should flow through Get A Job.ai to ensure a professional and organized experience.

Equal Employment Opportunity

Get A Job.ai is committed to inclusive recruitment practices. We welcome applicants from all backgrounds and provide equal opportunities regardless of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by law.