<p><p><b>Job Title :</b> Senior Data Engineer<br/><br/>Experience : 6+ Years<br/><br/><b>Location :</b> Chennai, India<br/><br/><b>Work Mode :</b> Hybrid (2-3 days/week onsite)<br/><br/><b>About the Role :</b><br/><br/>We are looking for a highly skilled Senior Data Engineer with a strong background in Python, Java, PySpark, and Google Cloud Platform (GCP) to join our growing data team in Chennai.
The ideal candidate should have a deep understanding of distributed data processing, cloud-based data solutions, and the ability to write clean, scalable, and efficient code.<br/><br/>You will be responsible for building and maintaining robust data pipelines and platforms that power real-time and batch data solutions across various business domains.<br/><br/><b>Key Responsibilities :</b><br/><br/>- Design, build, and maintain scalable, reliable, and high-performance data pipelines using PySpark, Python, and Java.<br/></p><p><br/></p><p>- Develop and deploy data integration solutions on Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer.<br/></p><p><br/></p><p>- Optimize data pipelines for performance and cost-efficiency in cloud environments.<br/></p><p><br/></p><p>- Collaborate closely with data scientists, analysts, and other engineers to support data initiatives.<br/></p><p><br/></p><p>- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.<br/></p><p><br/></p><p>- Ensure data quality, consistency, and governance through the implementation of best practices and automated checks.<br/></p><p><br/></p><p>- Monitor and troubleshoot production data pipelines, ensuring data availability and integrity.<br/><br/><b>Mandatory Skills :</b><br/><br/>- Python - Strong proficiency in scripting and data engineering using Python.<br/></p><p><br/></p><p>- Java - Solid experience in building and maintaining high-performance backend/data applications.<br/></p><p><br/></p><p>- PySpark - Hands-on experience with distributed data processing using PySpark on large datasets.<br/></p><p><br/></p><p>- Google Cloud Platform (GCP) - Expertise with GCP services including but not limited to :<br/></p><p><br/></p><p>1.
BigQuery<br/></p><p><br/></p><p>2.
Dataflow<br/></p><p><br/></p><p>3.
Cloud Storage<br/></p><p><br/></p><p>4.
Pub/Sub<br/></p><p><br/></p><p>5.
Composer (Airflow on GCP)<br/><br/><b>Required Qualifications :</b><br/><br/>- Bachelor's or Masters degree in Computer Science, Engineering, or a related field.<br/></p><p><br/></p><p>- 6+ years of proven experience in data engineering roles.<br/></p><p><br/></p><p>- Strong understanding of data structures, algorithms, and performance tuning.<br/></p><p><br/></p><p>- Excellent problem-solving and communication skills.<br/></p><p><br/></p><p>- Ability to work independently and in a hybrid team environment.<br/></p><p><br/><b>Why Join Us ?</b><br/><br/>- Opportunity to work on modern cloud-native data architectures.<br/></p><p><br/></p><p>- Collaborative, inclusive, and flexible work culture.<br/></p><p><br/></p><p>- Work-life balance with hybrid work mode.<br/></p><p><br/></p><p>- Career growth and upskilling opportunities.</p><br/></p> (ref:hirist.tech)