Azure Data Engineer - ETL/Python

<p>Responsibilities :<br/><br/>- Developing Modern Data Warehouse solutions using Databricks and Azure Stack.<br/><br/>- Ability to provide solutions that are forward-thinking in the data engineering and analytics space.<br/><br/>- Collaborate with DW/BI leads to understanding new ETL pipeline development requirements.<br/><br/>- Triage issues to find gaps in existing pipelines and fix the issues.<br/><br/>- Work with businesses to understand the need in the reporting layer and develop a data model to fulfill reporting needs.<br/><br/>- Help joiner team members to resolve issues and technical challenges.<br/><br/>- Drive technical discussions with client architects and team members.<br/><br/>- Orchestrate the data pipelines in the scheduler via Airflow.<br/><br/>Requirements :<br/><br/>- Must have a total of 5 years of IT experience in Data warehouse/ETL projects.<br/><br/>- Deep understanding of Star and Snowflake dimensional modeling.<br/><br/>- Strong knowledge of Data Management principles.<br/><br/>- Good understanding of Databricks Data & AI platform and Azure Data Factory Architecture OR ADF.<br/><br/>- Should have hands-on experience in SQL, Python, and Spark (PySpark).<br/><br/>- Candidate must have experience in Azure stack.<br/><br/>- Desirable to have ETL with batch and streaming (Kinesis).<br/><br/>- Experience in building ETL / data warehouse transformation processes.<br/><br/>- Experience working with structured and unstructured data including imaging & geospatial data.<br/><br/>- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, and GIT.<br/><br/>- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, and troubleshooting.<br/><br/>- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).<br/><br/>- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.<br/><br/>- Should have experience working in Agile methodology.<br/><br/>- Strong verbal and written communication skills.<br/><br/>- Strong analytical and problem-solving skills with high attention to detail.<br/><br/>- Mandatory Skills: Python/ PySpark / Spark with Azure/Azure Data Factory</p> (ref:hirist.tech)