<p><p>Location : Gurugram (Work from Office 5 Days)<br/><br/>Notice Period : Immediate to 45 Days<br/><br/><b>About the Role :</b><br/><br/>We are looking for an experienced Azure Data Engineering Lead with strong expertise in Azure Data Factory, Databricks, PySpark, and SQL.
This role requires both technical depth and leadership capability you will lead a team of 5+ engineers, architect and optimize data pipelines, and collaborate with stakeholders to deliver enterprise-scale data solutions.<br/><br/><b>Key Responsibilities :</b><br/><br/>- Data Pipeline Development: Design, develop, and maintain large-scale ETL/ELT pipelines using Azure Data Factory (ADF).<br/><br/></p><p>- Big Data Engineering: Work extensively with Azure Databricks to process, transform, and analyze large datasets using PySpark.<br/><br/></p><p>- Data Modeling & Optimization: Develop scalable data models, optimize queries, and ensure high performance across SQL-based systems.<br/><br/></p><p>- Architecture & Design: Define data engineering best practices and architect end-to-end Azure data solutions integrating multiple sources.<br/><br/></p><p>- Team Leadership: Lead, mentor, and guide a team of 5+ data engineers, ensuring high-quality delivery and adherence to project timelines.<br/><br/></p><p>- Collaboration: Partner with data scientists, BI developers, product managers, and business stakeholders to design solutions that meet business needs.<br/><br/></p><p>- Governance & Security: Implement data governance, lineage, and security practices to ensure compliance with enterprise standards.<br/><br/></p><p>- Continuous Improvement: Stay updated with Azure ecosystem enhancements, evaluate new tools/technologies, and drive innovation within the team.<br/><br/><b>Required Skills & Experience :</b><br/><br/>- 8+ years of overall IT/Data Engineering experience.<br/><br/></p><p>- Minimum 5 years of hands-on expertise in Azure Data Factory (ADF).<br/><br/></p><p>- Minimum 3 years of experience with Azure Databricks.<br/><br/></p><p>- Strong knowledge of PySpark for distributed data processing.<br/><br/></p><p>- Expertise in SQL (T-SQL/PL-SQL) for data transformations and performance tuning.<br/><br/></p><p>- Proven leadership experience (2+ years) managing teams of 5+ engineers.<br/><br/></p><p>- Strong understanding of Azure ecosystem (Data Lake, Synapse, Event Hub, Functions, Key Vault).<br/><br/></p><p>- Experience with CI/CD pipelines, Git, DevOps practices for data engineering.<br/><br/></p><p>- Excellent communication and stakeholder management skills.<br/><br/><b>Good to Have :</b><br/><br/>- Exposure to Azure Synapse Analytics or Snowflake.<br/><br/></p><p>- Knowledge of Delta Lake, Data Lakehouse architecture, or streaming pipelines.<br/><br/></p><p>- Experience in performance optimization and cost management in Azure environments.<br/><br/></p><p>- Understanding of Data Governance, Data Quality, and Security best practices.<br/><br/><b>Why Join Us ?</b><br/><br/>- Opportunity to work with a leading data consulting firm delivering cutting-edge data solutions.<br/><br/></p><p>- High visibility role with ownership of end-to-end Azure data engineering projects.<br/><br/></p><p>- Collaborative environment that values innovation, learning, and career growth.<br/></p><br/></p> (ref:hirist.tech)