Sword Health
What you’ll be doing:
- Spearhead the migration of existing workloads to the Iceberg format, establishing and maturing the foundational lakehouse architecture.
- Architect and construct robust batch and streaming data pipelines utilizing Spark and Flink technologies.
- Collaborate closely with the Backend Engineering team on API integrations and the establishment of formal data contracts.
- Contribute to the development of a unified lineage and governance framework utilizing DataHub.
- Provide comprehensive support to the Core Team in the successful adoption of new data platform capabilities.
What you need to have:
- Demonstrated proficiency with Python and PySpark.
- Hands-on experience with data lake formats (e.g., Iceberg, Delta Lake, or Hudi).
- Solid understanding of Kafka and event-driven architectures.
- Experience in building and orchestrating data pipelines at scale.
- Strong SQL proficiency and comprehensive data modeling knowledge.
- Familiarity with workflow orchestration tools (e.g., Airflow, Dagster, or similar).
- Platform-oriented mindset: developing solutions for broad organizational use, not solely individual purposes.
- Ownership mentality: committed to seeing problems through to resolution.
- Clear communication skills: ability to articulate complex technical concepts to non-technical stakeholders.
- Highly collaborative: excels in working alongside backend engineers, data engineers, and analysts.
- Pragmatic approach: adept at balancing ideal solutions with practical delivery timelines.
- Build and maintain AI-ready data infrastructure, ensuring clean, governed, and accessible data pipelines that power machine learning models and AI-driven products across the platform.
- Expected to leverage AI coding assistants and LLMs to accelerate development, automate documentation, and improve code quality across data pipelines.
- Bonus: Demonstrated expertise with Flink or comparable streaming frameworks.
- Bonus: Proficiency in DBT and familiarity with the modern data stack.
- Bonus: Experience with modern data platforms such as BigQuery, Trino, Snowflake, or Databricks.
- Bonus: Proven background in developing self-service data platforms.
To ensure you feel good solving a big Human problem, we offer:
- A stimulating, fast-paced environment with lots of room for creativity.
- A bright future at a promising high-tech startup company.
- Career development and growth, with a competitive salary.
- The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare.
- A flexible environment where you can control your hours (remotely) with unlimited vacation.
- Access to our health and well-being program (digital therapist sessions).
- Remote or Hybrid work policy.
- To get to know more about our Tech Stack, check here.
Portugal – Sword Benefits & Perks:
Originally posted on Himalayas
To apply for this job please visit himalayas.app.
Working in Portugal
Portugal, officially the Portuguese Republic, is a country in Southwestern Europe. It is a unitary republic comprising mainland Portugal, located on the southwestern of the Iberian Peninsula and bordered by Spain to the north and east, and the archipelagos of Madeira and the Azores in the Atlantic Ocean. The country has a population of over 10.7 million, and Lisbon, its capital, is the largest city. Portugal's internal waters and territorial sea together account for two-fifths of its territory, and its exclusive economic zone is one of Europe's largest, while its terrain contains a diverse ran
More jobs at Sword Health
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.