<p><p><b>Description : </b> This is a highly specific and senior-level role.
Here is a detailed job description for a Senior GCP Data Engineer.</p><br/><p>Role : Senior GCP Data Engineer (Full-Time Employee)</p><br/><p><b>Overview : </b></p><br/><p>We are seeking an experienced and dedicated Senior GCP Data Engineer to play a lead role in designing, building, and optimizing our next-generation cloud data platform.
The ideal candidate will have extensive hands-on experience with Google Cloud Platform (GCP) data services, possess deep expertise in big data processing using Spark, and be proficient in modern data warehousing and ETL/ELT practices.
This is a full-time position located in Chennai.</p><br/><p><b>Key Responsibilities : </b></p><br/><p>- Data Architecture & Design : Lead the design and implementation of scalable, reliable, and high-performance data pipelines and data warehouse solutions on Google Cloud Platform (GCP).</p><br/><p>- GCP Data Service Management : Architect and manage core GCP data services, including BigQuery for data warehousing, Dataproc for Spark workloads, and Cloud Storage for data lake solutions.</p><br/><p>- ETL/ELT Development : Develop, optimize, and maintain complex data processing jobs using PySpark for large-scale data transformations.</p><br/><p>- Workflow Orchestration : Design and manage automated data workflows using Cloud Composer (Apache Airflow) for scheduling, monitoring, and managing data pipelines.</p><br/><p>- Coding & Scripting : Write high-quality, efficient, and well-documented code primarily in Python for data ingestion, transformation, and service automation.</p><br/><p>- Data Modeling & Querying : Design optimized data models and write advanced, performant SQL queries within the BigQuery environment.</p><br/><p>- Performance Tuning : Proactively identify and resolve data pipeline bottlenecks, optimizing resource usage and minimizing data latency and cost.</p><br/><p>- Leadership & Mentorship : Provide technical guidance, perform code reviews, and mentor junior team members on best practices in GCP and data engineering.</p><br/><p><b>Required Skills & Qualifications : </b></p><br/><p>- Experience : 8 - 12 years of progressive experience in Data Engineering, with a significant focus on cloud-based data solutions.</p><br/><p>- Cloud Expertise : Deep, hands-on experience and a strong understanding of the Google Cloud Platform (GCP) data ecosystem.</p><br/><p>GCP Data Services : Expert-level proficiency in : </p><br/><p>- BigQuery : Advanced data warehousing, partitioning, clustering, cost optimization.</p><br/><p>- Dataproc : Cluster configuration, optimizing Spark jobs, and managing big data processing.</p><p><br/></p><p>- Cloud Storage : Data lake design and management, security, and lifecycle policies.</p><br/><p>- Cloud Composer (Airflow) : Designing, deploying, and managing complex DAGs (Directed Acyclic Graphs).</p><br/><p>- Programming : Strong command of Python for scripting, application development, and data manipulation.</p><br/><p>- Big Data Processing : Mandatory expert-level experience with PySpark for scalable data transformation and processing.</p><br/><p>- Data Querying : Advanced proficiency in SQL for complex queries, data analysis, and optimization.</p><br/><p>- Architecture : Proven ability to translate business requirements into scalable, reliable technical data architectures.</p><br/><p><b>Logistics & Hiring Details : </b></p><br/><p>- Position : Senior GCP Data Engineer (Full-Time Employee)</p><br/><p>- Location : Chennai</p><br/><p>- Experience : 8 - 12 Years</p><br/><p>- Budget : Commensurate with experience and skill set.</p><br/><p>- Notice Period : 0 - 20 Days (Serving Notice Period Candidates Only).
We are looking for immediate contributors.</p><br/></p> (ref:hirist.tech)