Know ATS Score
CV/Résumé Score
  • Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role: Lead Data Engineer Python/ETL/Scala.
India Jobs Expertini

Urgent! Lead Data Engineer - Python/ETL/Scala Job Opening In Chennai – Now Hiring Cynosure Corporate Solutions

Lead Data Engineer Python/ETL/Scala



Job description

<p><p><b>About the Role : </b><br/><br/>We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions.

The role requires strong expertise across multi-cloud environments, modern data warehousing platforms, programming languages, and data orchestration tools.

You will play a pivotal role in transforming raw data into actionable insights, ensuring data quality, and enabling analytics and reporting initiatives across the : </b><br/><br/>- Design, build, and optimize complex ETL/ELT data pipelines using Python, PySpark, Scala, and advanced SQL.<br/><br/></p><p>- Implement and manage ETL processes using Informatica PowerCenter, Databricks, AWS Glue, and Snowflake.<br/><br/></p><p>- Develop and deploy scalable data solutions across AWS, Azure, GCP, and Microsoft Fabric using cloud-native services.<br/><br/></p><p>- Manage and optimize databases, including Redshift, SQL Server, and AWS RDS.<br/><br/></p><p>- Orchestrate and monitor data workflows with Apache Airflow to ensure reliable and timely delivery.<br/><br/></p><p>- Implement streaming solutions with Apache Kafka and containerized services with Kubernetes.<br/><br/></p><p>- Automate data workflows and system monitoring using Unix shell scripting.<br/><br/></p><p>- Apply CI/CD practices to data pipelines and enforce Data Cleanroom principles for privacy-compliant collaboration.<br/><br/></p><p>- Collaborate with BI/reporting teams to deliver optimized datasets for Tableau, Looker, and Power BI.<br/><br/></p><p>- Troubleshoot and resolve performance issues in pipelines and database queries.<br/><br/></p><p>- Maintain detailed technical documentation and collaborate closely with cross-functional teams.<br/><br/><b>Qualifications : </b><br/><br/>- Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field.<br/><br/></p><p>- Experience : 5+ years for Senior Data Engineer, 8+ years for Lead Data Engineer.<br/><br/></p><p>- Languages : Proficiency in SQL, Python (including PySpark), Scala, and Unix Shell Scripting.<br/><br/></p><p>- ETL Tools : Hands-on experience with Informatica PowerCenter, Databricks, and AWS Glue.<br/><br/></p><p>- Data Warehousing : Expertise in Snowflake and Redshift.<br/><br/></p><p>- Cloud Platforms : Strong exposure to at least two of AWS, Azure, and GCP; familiarity with Microsoft Fabric.<br/><br/></p><p>- Databases : Solid knowledge of Redshift, SQL Server, and AWS RDS.<br/><br/></p><p>- Orchestration : Proven experience with Apache Airflow.<br/><br/></p><p>- Streaming & Containerization : Practical experience with Apache Kafka and Kubernetes.<br/><br/></p><p>- Concepts : Working knowledge of CI/CD pipelines and Data Cleanroom practices.<br/><br/></p><p>- Reporting Tools : Understanding of data provisioning for Tableau, Looker, or Power BI.<br/><br/></p><p>- Strong problem-solving skills, communication ability, and a proactive approach to emerging technologies.</p><br/></p> (ref:hirist.tech)


Required Skill Profession

Computer Occupations



Your Complete Job Search Toolkit

✨ Smart • Intelligent • Private • Secure

Start Using Our Tools

Join thousands of professionals who've advanced their careers with our platform

Rate or Report This Job
If you feel this job is inaccurate or spam kindly report to us using below form.
Please Note: This is NOT a job application form.


    Unlock Your Lead Data Potential: Insight & Career Growth Guide