Data Engineer - Databricks Expert

Data Engineer – Databricks Expert

Remote (India-based) |

Full-time |

Immediate Joiners Preferred

Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark?

We're looking for a seasoned Data Engineer to join our team and work on high-impact data products for a leading global client.

Tech Stack & Skills

- 5+ years in Python (incl.

Pytest for testing)
- 7+ years of SQL & Query Optimization
- 3+ years of API development
- Hands-on with Databricks CLI, DLT Pipelines, Unity Catalog, and Delta Lake
- Strong grasp of Apache Spark, Structured Streaming, Medallion Architecture
- Familiarity with Databricks Workflows, Asset Bundles, and REST APIs
- Solid understanding of CDC (Debezium preferred)
- Exposure to AWS, DevOps, CI/CD, and Git
- Experience with SQL Server, Data Warehousing, Semi-Structured Data, and MS SSIS

Key Responsibilities

- Develop and deploy robust DLT pipelines, workflows, and ingestion tasks
- Maintain production streaming and batch jobs with tight SLAs
- Monitor pipelines daily, troubleshoot failures, and document resolutions
- Analyze data lineage using codebase and Databricks tools
- Collaborate to automate data quality checks
- Write clean code, conduct PRs, testing, and deployments
- Communicate clearly on incidents, blockers, and task progress

What You Bring

- Strong problem-solving mindset
- Passion for clean, scalable, and well-documented code
- Ability to work independently and in a fast-paced environment
- Comfortable collaborating across time zones