Azure Data Engineer - Python/ETL

<p><p><b>Description : </b><br/><br/>We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and architectures in Microsoft Azure.<br/><br/>You will play a crucial role in enabling data-driven decision-making by transforming raw data into accessible, clean, and reliable datasets.<br/><br/>If you have hands-on experience with Azure data services and a passion for solving complex data challenges, this is an exciting opportunity to join a forward-thinking team shaping the future of data infrastructure.<br/><br/><b>Key Responsibilities : </b><br/><br/>- Design, develop, and maintain robust data pipelines using Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.<br/><br/>- Build scalable ETL/ELT processes to ingest, process, and transform large volumes of structured and unstructured data from various sources.<br/><br/>- Implement and optimize data storage solutions, including Azure Data Lake Storage, Azure SQL Database, and Cosmos DB.<br/><br/>- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver reliable data solutions.<br/><br/>- Monitor data quality, troubleshoot data issues, and implement data governance best practices.<br/><br/>- Automate workflows and data integration tasks using Azure Logic Apps, Functions, and PowerShell scripts.<br/><br/>- Ensure data security and compliance with organizational and regulatory policies.<br/><br/>- Document data pipelines, data flows, and architecture diagrams for knowledge sharing and auditing purposes.<br/><br/>- Stay current with Azure data technologies and industry trends to continuously improve data platform capabilities.<br/><br/><b>Requirements : </b><br/><br/><b>Experience : </b><br/><br/>- 3+ years of experience as a Data Engineer or similar role, preferably working with Azure cloud platforms.<br/><br/>- Proven experience designing and implementing data pipelines and ETL workflows on Azure.<br/><br/><b>Technical Skills : </b><br/><br/>- Strong proficiency with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage.<br/><br/>- Solid understanding of SQL and experience working with relational and NoSQL databases.<br/><br/>- Experience with data modeling, data warehousing concepts, and performance optimization.<br/><br/>- Knowledge of programming languages such as Python, Scala, or SQL for data transformation and automation.<br/><br/>- Familiarity with containerization (Docker) and orchestration tools (Kubernetes) is a plus.<br/><br/>- Experience with version control systems (Git) and CI/CD pipelines in a cloud environment.<br/><br/><b>Soft Skills : </b><br/><br/>- Strong analytical and problem-solving skills.<br/><br/>- Excellent communication skills, capable of working with both technical and non-technical stakeholders.<br/><br/>- Ability to work independently and collaboratively in a fast-paced environment.<br/><br/><b>Education : </b><br/><br/>- Bachelors degree in Computer Science, Information Technology, or related field preferred.<br/><br/>- Equivalent experience considered</p><br/></p> (ref:hirist.tech)