Data Engineer - ETL/Python

<p><p><b>Key Responsibilities :</b><br/><br/>- Design, develop, and maintain robust, scalable, and efficient data pipelines.<br/><br/></p><p>- Work with structured and unstructured data to enable analytics and reporting.<br/><br/></p><p>- Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver data-driven solutions.<br/><br/></p><p>- Optimize and automate ETL processes to ensure high data quality and integrity.<br/><br/></p><p>- Develop and manage data models, schemas, and integrations with data warehouses/lakes.<br/><br/></p><p>- Implement data governance, security, and compliance best practices.<br/><br/></p><p>- Monitor, troubleshoot, and improve performance of data systems.<br/><br/></p><p>- Stay updated on emerging trends and technologies in the data engineering space.<br/><br/><b>Required Skills & Qualifications :</b><br/><br/>- Bachelors/Masters degree in Computer Science, IT, or related field.<br/><br/></p><p>- 7+ years of experience in data engineering roles.<br/><br/></p><p>- Strong expertise in SQL, Python, and ETL development.<br/><br/></p><p>- Hands-on experience with cloud platforms (AWS, Azure, or GCP).<br/><br/></p><p>- Proficiency in big data technologies (Hadoop, Spark, Kafka, etc.).<br/><br/></p><p>- Experience with data warehousing solutions (Snowflake, Redshift, BigQuery, etc.).<br/><br/></p><p>- Strong understanding of data modeling, data lakes, and data pipelines.<br/><br/></p><p>- Familiarity with Docker/Kubernetes for deployment and containerization.<br/><br/></p><p>- Excellent problem-solving and analytical skills.<br/><br/></p><p>- Strong communication and collaboration abilities.<br/><br/><b>Good to Have :</b><br/><br/>- Experience with workflow orchestration tools (Airflow, Luigi, Prefect).<br/><br/></p><p>- Knowledge of machine learning pipelines and integration.<br/><br/></p><p>- Exposure to NoSQL databases (MongoDB, Cassandra).</p><br/></p> (ref:hirist.tech)