We are seeking an experienced GCP Data Engineer with expertise in Dataproc and BigQuery to join our team in India.
The ideal candidate will have a strong background in designing and implementing data pipelines that support data analytics and business intelligence initiatives.
Responsibilities
- Designing, building, and maintaining scalable data pipelines on Google Cloud Platform (GCP) using Dataproc and BigQuery.
- Collaborating with data scientists and analysts to understand data requirements and provide solutions.
- Optimizing data storage and retrieval processes for efficiency and performance in BigQuery.
- Implementing data governance and security measures to protect sensitive information.
- Monitoring and troubleshooting data pipeline performance and issues.
- Conducting data quality checks and ensuring the integrity of data processed through GCP services.
Skills and Qualifications
- 8-10 years of experience in data engineering or related field.
- Strong proficiency in GCP services, specifically Dataproc and BigQuery.
- Experience with ETL processes and data modeling.
- Proficient in SQL and familiarity with programming languages such as Python or Java.
- Knowledge of data warehousing concepts and best practices.
- Experience in working with large datasets and distributed data processing frameworks.
- Familiarity with data governance and security best practices.
- Excellent problem-solving skills and ability to work in a team-oriented environment.
Skills Required
BigQuery, Dataproc, Data Warehousing, Sql, Cloud Architecture, Python