Shop Your Way
SYW Overview
Key Highlights include:
Roles Summary: Cloud Data/Systems Engineer
Responsibilities:
- Work with implementation teams from concept to operations, providing deep technical subject matter expertise for successfully deploying large scale data solutions in the enterprise, using modern data/analytics technologies on premise and cloud
- Build and implement a solution architecture, provision infrastructure, secure and reliable data-centric services and application in GCP
- Work with data team to efficiently use Cloud infrastructure to analyze data, build models, and generate reports/visualizations
- Integrate massive datasets from multiple data sources for data modeling
- Design, build, implement and manage APIs and API proxies.
- Organizes and implements all API development processes internally and externally.
- Ensures that API’s are satisfactory to business requirements, including features, infrastructure and systems
- Troubleshoots and tests all features, systems, and functionality of end products.
- Implement methods for automation of all delivery components to minimize labor in development and production
- Formulate business problems as technical data problems while ensuring key business drivers are captured in collaboration with product management
- Knowledge in machine learning algorithms especially in recommender systems
- Extracting, Loading, Transforming, cleaning, and validating data
- Designing pipelines and architectures for data processing
- Creating and maintaining machine learning and statistical models
- Querying datasets, visualizing query results and creating reports
Requirements:
- BS, MS or PhD in Computer Science, Engineering, Economics, Business or Mathematics.
- 3+ years experience in designing and optimizing data models on GCP cloud using GCP data stores such as BigQuery, BigTable.
- 3+ years experience analyzing, re-architecting and re-platforming on-premise data warehouses to data platforms on GCP cloud using GCP/3rd party services.
- 3+ years hands-on experience architecting and designing data lakes on GCP cloud serving analytics, BI application integrations and implementing scalable API solutions at production scale.
- Minimum 3 year of experience in performing detailed assessments of current state data platforms and creating an appropriate transition path to GCP cloud.
- Minimum 3 year of designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture using Java, Python, Scala etc.
- Hands-on experience with Spark, Cloud DataProc, Cloud Dataflow, Apache Beam, BigTable, Cloud BigQuery, Cloud PubSub, Cloud Functions, etc.
- Experience in architecting and implementing metadata management, data governance and security for data platforms on GCP.
- Experience in designing operations architecture and conducting performance engineering for large scale data lakes a production environment.
- Experience architecting and operating large production Hadoop/NoSQL clusters on premise or using Cloud services.
Preferred Requirements:
- Expert knowledge of network, internet and data storage security, software engineering best practices across the development lifecycle, agile methodologies, coding standards, source management, and building processes for testing, and operations.
- Extremely comfortable with communicating with users, other technical teams, and senior management to collect requirements and describe data modeling decisions and data engineering strategy.
- Skilled in communicating with remote teams across different time zones.
- Is accustomed to working with cross-functional teams to troubleshoot and resolve errors
- Google Cloud Platform certification is a plus.
Originally posted on Himalayas
To apply for this job please visit himalayas.app.
Working in United States
The United States of America (USA), also known as the United States (U.S.) or America, is a country primarily located in North America. It is a federal republic consisting of 50 states and a federal capital district, Washington, D.C. The 48 contiguous states border Canada to the north and Mexico to the south, with the semi-exclave of Alaska in the northwest and the archipelago of Hawaii in the Pacific Ocean. The United States also asserts sovereignty over five major island territories and various uninhabited islands in Oceania and the Caribbean. It is a megadiverse country, with the world's th
More jobs at Shop Your Way
Keep exploring on Get A Job.ai
Not quite the right fit? Your next opportunity is a click away.
- Browse all jobs
- More jobs by category
- Remote jobs you can do from anywhere
- Research typical pay for this role
- Set a job alert so new matches reach you first
- Upload your resume to apply faster
Hiring instead? Post a job and reach candidates searching right now.