Adastra - Databricks Data Engineer - Python/ETL/SQL

<p><p><b>As a Databricks Data Engineer, you will be responsible for : </b><br/><br/>- Technical Requirements Gathering and Development of Functional Specifications.<br/><br/>- Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Data Factory, and other Azure services.<br/><br/>- Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.<br/><br/>- Develop and integrate custom machine learning models using Azure Machine Learning, MLflow, and other relevant libraries.<br/><br/>- Leverage Azure DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure.<br/><br/>- Conducting troubleshooting on data models.<br/><br/>- Work with the Agile multicultural teams in Asia, the EU, Canada, and the Requirements :</b></p><br/>For this position as Databricks Data Engineer, we are looking for someone with : <br/><br/>- (Required) At least 6 years of experience in developing and maintaining data pipelines using Azure Databricks, Azure Data Factory, and Spark.<br/><br/>- (Required) Hands-on experience with Unity Catalog<br/><br/>- (Required) Fluent English communication and soft skills.<br/><br/>- (Required) Knowledge and Experience in CICD such as Terraform, ARM, and Bicep Script.<br/><br/>- (Required) Solid technical skills in Python, and SQL<br/><br/>- (Required) Familiarity with machine learning concepts, tools, and libraries (e.g., TensorFlow, PyTorch, Scikit-learn, MLflow)<br/><br/>- (Required) Strong problem-solving, communication, and analytical skills.<br/><br/>- Willingness to learn and expand technical skills in other areas.</p><br/></p> (ref:hirist.tech)