Infocus Technologies - Azure Databricks Engineer - Big Data Solutions

<p>Role Overview :<br/><br/>We are seeking a skilled Azure Databricks Engineer to join our growing cloud data engineering team.<br/><br/> The ideal candidate will be responsible for designing, developing, and implementing scalable data processing solutions on Azure Cloud using Databricks, Azure Data Factory, and PySpark.<br/><br/> This role requires hands-on experience with end-to-end data pipeline development, strong analytical thinking, and the ability to collaborate across business and technical teams.<br/><br/>Key Responsibilities :<br/><br/>- Design, build, and maintain data pipelines and ETL workflows using Azure Databricks and Azure Data Factory (ADF).<br/><br/>- Develop and optimize PySpark scripts for large-scale data processing and transformation.<br/><br/>- Integrate data from multiple sources into Azure-based storage and analytics platforms.<br/><br/>- Implement best practices for data quality, performance, and reliability.<br/><br/>- Collaborate with cross-functional teams to understand business requirements and translate them into scalable data engineering solutions.<br/><br/>- Ensure proper data governance, monitoring, and security in all workflows.<br/><br/>- Troubleshoot data pipeline issues, perform root-cause analysis, and recommend performance improvements.<br/><br/>- Stay current with Azure ecosystem developments, Databricks feature updates, and emerging data technologies.<br/><br/>Preferred Candidate Profile :<br/><br/>- 3 to 5 years of hands-on experience with Azure Databricks, Azure Data Factory, and PySpark.<br/><br/>- Strong understanding of Azure Cloud architecture, data lake concepts, and data ingestion frameworks.<br/><br/>- Proficiency in SQL, Python, and data modeling.<br/><br/>- Experience in performance tuning and optimization of big data solutions.<br/><br/>- Familiarity with DevOps practices and CI/CD pipelines for data workflows is a plus.<br/><br/>- Excellent problem-solving, communication, and documentation skills.<br/><br/>- Ability to work independently and collaboratively in a fast-paced environment<br/><br/></p> (ref:hirist.tech)