Elanco - Data Engineer - Azure Data Factory

<p><p><b>Role Overview :</b><br/><br/>We are seeking a skilled Data Engineer to join our growing data and analytics team.<br/><br/>The ideal candidate will design, build, and optimize scalable data pipelines, ensuring clean, reliable, and high-performance data delivery for analytics and machine learning initiatives.<br/><br/>You will work with cloud-native tools, especially Azure Data Factory (ADF), Databricks, and Python, to support enterprise-wide digital transformation.<br/><br/><b>Key Responsibilities :</b><br/><br/>- Design, develop, and maintain end-to-end ETL/ELT data pipelines using ADF and Databricks.<br/><br/>- Implement robust data ingestion frameworks for structured, semi-structured, and unstructured data sources.<br/><br/>- Collaborate with business stakeholders, data scientists, and analysts to deliver high-quality datasets.<br/><br/>- Develop and optimize data models and data lakes to support BI and ML workloads.<br/><br/>- Ensure data quality, lineage, and governance across pipelines.<br/><br/>- Automate workflows and monitoring for data jobs, ensuring minimal downtime.<br/><br/>- Troubleshoot issues, optimize performance, and ensure scalability of data solutions.<br/><br/>- Document technical processes, workflows, and best practices for knowledge sharing.<br/><br/><b>Required Skills & Qualifications :</b><br/><br/>- Strong expertise in Azure Data Factory (ADF), Databricks, and Python programming.<br/><br/>- Solid understanding of SQL, data warehousing, and big data ecosystems.<br/><br/>- Experience with data modeling, schema design, and performance optimization.<br/><br/>- Strong problem-solving and debugging skills in large-scale distributed data environments.<br/><br/>- Familiarity with Agile methodologies and DevOps concepts for data engineering.<br/><br/><b>Preferred Skills :</b><br/><br/>- Knowledge of Delta Lake, Spark, or Synapse Analytics.<br/><br/>- Hands-on experience with CI/CD pipelines for data solutions.<br/><br/>- Exposure to cloud platforms like Azure/AWS/GCP<br/></p><br/></p> (ref:hirist.tech)