Data Engineer - Azure Platform

<p><p><b>Description :</b></p><p><p><b><br/></b></p>- Integrating data from various sources into a unified Azure data warehouse and suitable data marts.<br/><br/>- Continuously monitoring and testing the availability, performance and quality of data pipelines.<br/><br/>- Collaborating with peers by employing and following SDLC best practice while maintaining code repositories and activity using Agile, DevOps and CI/CD methodologies through Dev, Test and QA environments<br/><br/>- Working closely with stakeholders to understand ongoing requirements, build effective products and align data modelling principles.<br/><br/>- Adhering to agreed Release and Change Management Processes.<br/><br/>- Troubleshoot and investigate anomalies and bugs in code or data.<br/><br/>- Adhering to test and reconciliation standards to produce confidence in delivery.<br/><br/>- Produce appropriate and comprehensive documentation to support ease of access for technical and non-technical users.<br/><br/>- Engage in a culture of continual process improvement and best practice.<br/><br/>- Efficiently respond to changing business priorities through effective time management.<br/><br/>- Conduct all activities and duties in line with company policy and compliantly.<br/><br/>- To carry out any other ad-hoc duties as requested by management.<br/><br/><b>EXPERIENCE :</b></p><p><p><b><br/></b></p>- 6+ years of total experience into IT industry as a developer/senior developer/data engineer<br/><br/>- 4+ years of experience of working extensively with Azure services such as Azure Data Factory, Azure Synapse and Azure Datalake<br/><br/>- 3+ years of experience working extensively with Azure SQL, MS SQL Server and good exposure into writing complex SQL queries.<br/><br/>- Good knowledge and exposure into important SQL concepts such as Query optimization, Data Modelling and Data Governance<br/><br/>- Working Knowledge of CI/CD process using Azure DevOps and Azure Logic Apps<br/><br/>- Very good written and verbal communication skills<br/><br/><b>Key skills required :</b></p><p><p><b><br/></b></p>- Azure Data Factory, Azure Synapse, Azure SQL, Azure SQL Datawarehouse, MS SQL Server, Azure DevOps, Azure Logic Apps, Azure Datalake<br/><br/>- Solid experience of ADF meta-data driven Integration runtimes, pipelines, data flows.<br/><br/>- Experienced in design and implementation of end-to-end ELT pipelines using Data Factory, Delta Live Tables, structured streaming<br/><br/>- Experience and understanding of Azure fundamentals, networking and security.<br/><br/>- Experience working with traditional relational Data warehouses, SQL Server or other database technologies.</p><br/></p> (ref:hirist.tech)