Databricks SQL Engineer - Python

<p><p><b>Job Description : </b><br/><br/>- Years of Experience : 5+ years (PHARMA MANDATORY)<br/><br/>- Role Type : Fixed Term Contract (6 Months)<br/><br/>- Payroll Organization : Talpro<br/><br/>- Shift Timing : Day shift IST, from 12pm<br/><br/>- Notice Period : Immediate Joiners Only<br/><br/>- Work Location : Mumbai / Pune / Bangalore / Chennai / Ahmedabad / Noida (Chennai Most Preferred)<br/><br/>- Work Mode : Hybrid (3 Days from Office Weekly)<br/><br/><b>Mandatory Skills : </b><br/><br/>- Databricks<br/><br/>- SQL<br/><br/>- PySpark<br/><br/>- Pharma or Life Sciences domain experience<br/><br/><b>Good to Have Skills : </b><br/><br/>- Delta Lake<br/><br/>- Data Lakehouse Architecture<br/><br/>- Unity Catalog or similar data governance tools<br/><br/>- SQL development & performance tuning with large datasets<br/><br/>- Git for version control<br/><br/>- CI/CD for data pipelines (Databricks Repos, Terraform, dbx)<br/><br/>- Azure Databricks or Databricks on AWS<br/><br/>- Python for data manipulation<br/><br/>- Structured streaming in Spark<br/><br/>- Azure Purview or equivalent governance tools<br/><br/>- Automation experience with Terraform/dbx<br/><br/>- Databricks Notebooks<br/><br/>- Data documentation and dictionary practices<br/><br/><b>Role Overview / Job Summary : </b><br/><br/>We are looking for an experienced Databricks SQL Engineer with a Pharma or Life Sciences background to join our offshore Data Engineering team.<br/><br/>This role focuses on building efficient, scalable SQL-based data models and pipelines using Databricks SQL, Spark SQL, and Delta Lake.<br/><br/>The ideal candidate will play a key role in transforming raw data into valuable analytical insights, enabling critical decision-making across pharma-related business functions.<br/><br/><b>Key Responsibilities / Job Responsibilities : </b><br/><br/>- Design and optimize SQL queries and data models in Databricks for large-scale datasets<br/><br/>- Develop and maintain robust ETL/ELT pipelines using Databricks workflows<br/><br/>- Implement Delta Lake and Unity Catalog for secure and governed data assets<br/><br/>- Ensure data quality via validation, testing, and monitoring mechanisms<br/><br/>- Optimize performance and cost for the data lakehouse environment<br/><br/>- Collaborate with stakeholders to support analytics and business needs<br/><br/>- Deploy notebooks and SQL workflows using CI/CD best practices<br/><br/>- Document pipelines, queries, and data models to foster self-service<br/></p><br/></p> (ref:hirist.tech)