Position Description:
Azure ETL Data Engineer - 2-6 YearsJob Description for Azure ETL Data Engineer:• Design and develop ETL processes based on functional and non-functional requirements in Azure platform• Design and develop migration process from SQL Server to Azure platform• Understand the full end to end development activities from design to go live for ETL development in Azure platform• Recommend and execute improvements• Document component design for developers and for broader communication.• Understand and adopt an Agile (SCRUM like) software development mindset• Follow established processes/standards, business technology architecture for development, release management and deployment process• Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.Job Requirement for Azure ETL Data Engineer:Must-have skills• Undergraduate Degree or Technical Certificate.• Microsoft Azure certified – Data Engineer• Working experience (> 3 years) in Azure Data Factory, Azure Databricks, ADLS, Datadog, Azure SQL DB, Azure Synapse• Hands-on experience in Python / Spark / Pyspark / JSON• SQL Server (SSIS)• Working experience with data modeling, relational modeling and dimensional modeling• General knowledge about file formats (e.g. XML, CSV, JSON), databases (e.g. MS SQL, Oracle) and different type of connectivity is also very useful.• Data files movement via mailbox• Source-code versioning/promotion tools, e.g. Git/Jenkins• Orchestration tools in Azure platformNice-to-have skills• Sqoop / Hadoop / Shell Script• Java / Scala• Experience in Agile environment• Tracking and collaboration tools (e.g. JIRA, Confluence, MS Teams)
Skills:
• Azure Data Factory
• Azure Databricks
• Azure Data Lake
• Data Engineering
• Azure SQL Data Warehouse
• SQL
• PowerShell
• Python
• Pyspark
Skills: