Data Engineer - Python/SQL/ETL

<p><p><b>Description : </b></p><p><p><b><br/></b></p><br/>We are seeking a highly skilled Data Engineer to design, develop, and optimize scalable data pipelines and solutions on Google Cloud Platform (GCP).<br/><br/>The ideal candidate will have strong expertise in BigQuery, SQL, Python/Java, and hands-on experience in building robust data pipelines to support advanced analytics and business intelligence.<br/><br/><b>Key Responsibilities : </b></p><p><p><b><br/></b></p><br/>- Design, develop, and maintain scalable data pipelines and ETL/ELT processes.<br/><br/>- Work extensively on GCP services including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Composer.<br/><br/>- Optimize data models and queries for performance and cost efficiency in BigQuery.<br/><br/>- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.<br/><br/>- Ensure data quality, governance, and security across all data pipelines and storage systems.<br/><br/>- Troubleshoot and resolve data pipeline issues in real time.<br/><br/>- Contribute to architecture design discussions and provide best practices for data engineering.<br/><br/><b>Required Skills : </b></p><p><p><b><br/></b></p><br/>- Strong hands-on experience with Google Cloud Platform (GCP), particularly BigQuery.<br/><br/>- Proven expertise in building and maintaining data pipelines.<br/><br/>- Strong SQL skills for query optimization and large-scale data manipulation.<br/><br/>- Proficiency in Python or Java for developing scalable ETL/ELT solutions.<br/><br/>- Good understanding of data modeling, partitioning, and performance tuning.<br/><br/>- Experience with workflow orchestration tools (e.g., Airflow/Cloud Composer) is a plus.<br/><br/>- Familiarity with CI/CD, version control (Git), and agile methodologies.<br/><br/><b>Good to Have : </b></p><p><p><b><br/></b></p><br/>- Exposure to streaming data pipelines (Pub/Sub, Kafka).<br/><br/>- Knowledge of machine learning pipelines integration.<br/><br/>- Experience with other cloud platforms (AWS/Azure).<br/><br/><b>Soft Skills : </b></p><p><p><b><br/></b></p><br/>- Strong analytical and problem-solving skills.<br/><br/>- Excellent communication and collaboration abilities.<br/><br/>- Ability to work independently and as part of a team in a fast-paced environment.<br/><br/></p><br/></p> (ref:hirist.tech)