Data Engineer/Lead - Python/SQL

<p>Job Description :<br/><br/>At Our Client, we are seeking a Data Engineer - Lead to architect and scale enterprise-grade data platforms, manage and mentor a growing team, and drive the design and implementation of high-performance, cloud-native data solutions that power advanced analytics and AI initiatives.<br/><br/>Requirements : <br/><br/>- 7+ years of experience in data engineering, including at least 2+ years in a leadership or lead role.<br/><br/>- Proven ability to lead and manage data engineering teams, provide mentorship, and drive strategic initiatives.<br/><br/>- Strong expertise in architecting enterprise-scale data platforms and multi-tenant infrastructure.<br/><br/>- Hands-on experience with data lake/warehouse solutions (Redshift, BigQuery, Snowflake, Delta Lake, Apache Iceberg).<br/><br/>- Expert-level proficiency in Python, SQL, and data modeling.<br/><br/>- Deep knowledge of distributed systems, data processing frameworks, and system design.<br/><br/>- Advanced experience with cloud platforms (AWS, GCP, Azure), infrastructure as code, and containerization.<br/><br/>- Strong background in real-time and batch data pipelines using Airflow, Kafka, Spark, Flink.<br/><br/>- Experience implementing data governance, lineage, quality frameworks, and observability standards.<br/><br/>- Skilled in performance optimization for queries, storage, and infrastructure at scale.<br/><br/>- Knowledge of CI/CD workflows, testing strategies, and deployment automation.<br/><br/>- Experience with streaming platforms (Kafka, Kinesis) and event-driven architectures.<br/><br/>- Proficiency with modern table formats (Apache Iceberg, Delta Lake) and lake house architectures.<br/><br/>- Demonstrated ability in strategic thinking, stakeholder management, and cross-team collaboration.<br/><br/>- Experience in budget planning, vendor management, and technical recruitment.<br/><br/>- Excellent communication and leadership skills to drive collaboration between Data, ML, Analytics, and Engineering teams.<br/><br/>Good to Have :<br/><br/>- Experience with DBT for data transformation and modeling.<br/><br/>- Familiarity with data observability tools (e.g., Monte Carlo, Great Expectations).</p> (ref:hirist.tech)