Senior Data Engineer - Python/PySpark

<p><p><b>Job Title :</b> Senior Data Engineer</p><br/><p><b>Location :</b> Chennai (Hybrid 4 days from office per week)</p><br/><p><b>Experience :</b> 7+ Years</p><br/><p><b>Notice Period :</b> Immediate joiners only</p><br/><p><b>Job Type :</b> Full-time</p><br/><p><b>Key Responsibilities :</b></p><p><b><br/></b></p><p>- Collaborate with business and technology stakeholders to understand current and future data requirements.</p><p><br/></p><p>- Design, build, and maintain reliable, efficient, and scalable data infrastructure for data collection, storage, transformation, and analysis.</p><p><br/></p><p>- Plan, design, and develop scalable data solutions, including data pipelines, data models, and applications for efficient and reliable workflows.</p><p><br/></p><p>- Design, implement, and maintain data platforms such as data warehouses, data lakes, and lakehouses for structured and unstructured data.</p><p><br/></p><p>- Develop and optimize analytical tools, algorithms, and programs to support data engineering activities, including scripting and task automation.</p><p><br/></p><p>- Monitor and ensure optimum system performance while identifying opportunities for continuous improvement.</p><br/><p><b>Required Skills :</b></p><p><b><br/></b></p><p>- BigQuery and Google Cloud Platform (GCP) (BigQuery, Dataflow, Dataproc, Data Fusion, Cloud SQL).</p><p><br/></p><p>- Airflow, PySpark, Python, and API development.</p><p><br/></p><p>- Terraform and Tekton for infrastructure as code and CI/CD automation.</p><p><br/></p><p>- Strong knowledge of PostgreSQL and SQL optimization.</p><br/><p><b>Preferred Skills :</b></p><p><b><br/></b></p><p>- Experience with large-scale data solutions in BigQuery, GCP, Airflow, Tekton, and Terraform.</p><p><br/></p><p>- Strong background in building end-to-end pipelines and productionizing workflows.</p><br/><p><b>Qualifications Required :</b> Bachelors Degree in Computer Science, Information Technology, or related Preferred :</b> Advanced degree in a relevant discipline (optional).</p><br/></p> (ref:hirist.tech)