Job Overview:
We are urgently looking for a highly skilled and experienced Senior Azure Data Engineer to join our team.
The ideal candidate must have a solid background in Azure Data Factory (ADF), Databricks, PySpark, and strong hands-on experience with modern data tools and platforms.
This is a client-facing role requiring excellent communication skills, flexibility, and strong problem-solving capabilities.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines and ETL processes using Azure Data Factory and Databricks
- Develop and optimize PySpark jobs for large-scale data processing
- Integrate various data sources into a unified data lake/warehouse environment
- Implement data governance practices using Unity Catalog and manage metadata effectively
- Work closely with stakeholders to understand business requirements and translate them into technical solutions
- Monitor, troubleshoot, and improve existing data workflows and performance
- Collaborate with BI developers to support Power BI reporting and dashboards
- Utilize Azure DevOps (ADO) for CI/CD pipelines and version control
Must-Have Skills:
- Azure Data Factory (ADF) Advanced knowledge
- Azure Platform End-to-end data engineering experience
- Databricks & PySpark Strong development experience
- SQL Excellent query optimization and data manipulation skills
- Azure DevOps (ADO) Familiar with CI/CD practices
- Power BI Ability to support data modeling and integration
- Unity Catalog Hands-on experience in metadata and data governance
- Excellent Communication Skills Verbal and written, must be client-facing ready
Preferred Qualifications:
- Azure Data Engineer or Azure Architect Certification
- Previous experience in Agile environments
- Exposure to data security and compliance practices in Azure
- Strong problem-solving and analytical thinking