- Full Time
- Bangalore, Hybrid
Arcana Analytics
Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of innovative solutions. This pivotal role not only demands your proficiency in developing and elevating compute and I/O-intensive applications but also ensures their peak performance and unwavering reliability.
Responsibilities:
- Develop and implement real-time data ingestion and processing systems.
- Design, build, and operationalize large-scale enterprise data solutions and applications.
- Create and manage production data pipelines, from ingestion to consumption, within a big data architecture using PySpark.
- Leverage expertise in Python, Airflow, SQL, and cloud platforms to build robust solutions (strong knowledge of these is essential).
- Translate complex business challenges into scalable and efficient technical solutions.
- Work collaboratively with a high-performing data engineering team, owning the full lifecycle of solution implementation.
Requirements:
- Bachelor’s Degree in Computer Science, Information Technology, or a similar discipline.
- 3 – 8 years of professional experience in data engineering or related fields.
- Proven experience with ETL processes, data integration, and handling large-scale datasets using PySpark.
- Strong understanding of data engineering concepts like ETL, near/real-time streaming, data structures, and workflow management.
- Experience with version control tools like Git/GitHub.
- Proficiency in SQL and Data Warehouse concepts.
- Experience working with SQL or NoSQL databases like Cassandra, MongoDB, or HBase.
- Knowledge of AWS technologies such as EMR, RedShift, Kinesis, Lambda, Glue, S3 IAM, CloudWatch, and big data tools like Hadoop/EMR, Hive, and Sqoop.
To apply for this job please visit job-boards.greenhouse.io.
Explore Arcana Analytics online
Working in Bangalore, Karnataka
Weather right now in Bangalore, Karnataka: checking… · Local time: · Air quality: · Daylight:
Bengaluru, also known as Bangalore, is the capital and largest city of the southern Indian state of Karnataka. As per the 2011 census, the city had a population of 8.4 million, making it the third most populous city in India and the most populous in South India. The Bengaluru metropolitan area had a population of around 8.5 million, making it the fifth most populous urban agglomeration in the country. It is located towards the southern end of the Deccan Plateau, at an altitude of 900 m (3,000 ft) above sea level. The city is known as India's "Garden City", due to its parks and greenery.
Karnataka is a state in the southwestern coast of India. It was formed as Mysore State on 1 November 1956, with the passage of the States Reorganisation Act, and renamed Karnataka in 1973. The state is bordered by the Lakshadweep Sea to the west, Goa to the northwest, Maharashtra to the north, Telangana to the northeast, Andhra Pradesh to the east, Tamil Nadu to the southeast, and Kerala to the so
🇮🇳 Relocation safety for India: High Risk — via Warnely, CC BY 4.0
- Elevation 921m (3,022 ft)
Source: Wikipedia (state)
Job details above are provided by the employer/source. The sections on this page are compiled from public data sources with AI assistance.
Accommodations: if you need a workplace accommodation to apply for or perform this job, see ADA.gov or EEOC.gov for guidance on your rights and how to request one.
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.