Senior Data Engineer - Python/ETL

<p><p><b>Key Responsibilities :</b><br/><br/>Our client seeking an experienced and motivated Senior Data Engineer to join their AI & Automation team.<br/><br/> The ideal candidate will have 58 years of experience in data engineering, with a proven track record of designing and implementing scalable data solutions.<br/><br/>A strong background in database technologies, data modeling, and data pipeline orchestration is essential.<br/><br/> Additionally, hands-on experience with generative AI technologies and their applications in data workflows will set you apart.<br/><br/> In this role, you will lead data engineering efforts to enhance automation, drive efficiency, and deliver data driven insights across the organization.<br/><br/><b>Job Description :</b><br/><br/>- Design, build, and maintain scalable, high-performance data pipelines and ETL/ELT processes across diverse database platforms.<br/><br/>- Architect and optimize data storage solutions to ensure reliability, security, and scalability.<br/><br/>- Leverage generative AI tools and models to enhance data engineering workflows, drive automation, and improve insight generation.<br/><br/>- Collaborate with cross-functional teams (Data Scientists, Analysts, and Engineers) to understand and deliver on data requirements.<br/><br/>- Develop and enforce data quality standards, governance policies, and monitoring systems to ensure data integrity.<br/><br/>- Create and maintain comprehensive documentation for data systems, workflows, and models.<br/><br/>- Implement data modeling best practices and optimize data retrieval processes for better performance.<br/><br/>- Stay up-to-date with emerging technologies and bring innovative solutions to the team.<br/><br/><b>Qualifications :</b><br/><br/>- Bachelor's or Masters degree in Computer Science, Information Technology, or a related field.<br/><br/>- 5 to 8 years of experience in data engineering, designing and managing large-scale data systems.<br/><br/>Strong expertise in database technologies, including :<br/><br/>- SQL Databases : PostgreSQL, MySQL, SQL Server<br/><br/>- NoSQL Databases : MongoDB, Cassandra<br/><br/>- Data Warehouse/ Unified Platforms : Snowflake, Redshift, BigQuery, Microsoft Fabric<br/><br/>- Hands-on experience implementing and working with generative AI tools and models in production workflows.<br/><br/>- Proficiency in Python and SQL, with experience in data processing frameworks (e., Pandas, PySpark).<br/><br/>- Experience with ETL tools (e., Apache Airflow, MS Fabric, Informatica, Talend) and data pipeline orchestration platforms.<br/><br/>- Strong understanding of data architecture, data modeling, and data governance principles.<br/><br/>- Experience with cloud platforms (preferably Azure) and associated data services.<br/><br/><b>Skills :</b><br/><br/>- Advanced knowledge of Database Management Systems and ETL/ELT processes.<br/><br/>- Expertise in data modeling, data quality, and data governance.<br/><br/>- Proficiency in Python programming, version control systems (Git), and data pipeline orchestration tools.<br/><br/>- Familiarity with AI/ML technologies and their application in data engineering.<br/><br/>- Strong problem-solving and analytical skills, with the ability to troubleshoot complex data issues.<br/><br/>- Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders.<br/><br/>- Ability to work independently, lead projects, and mentor junior team members.<br/><br/>- Commitment to staying current with emerging technologies, trends, and best practices in the data engineering domain<br/><br/></p><br/></p> (ref:hirist.tech)