Celebal Technologies - Data Engineer - Python/SQL

<p><b>Responsibilities : </b><br/><br/><b>Platform Expertise : </b><br/><br/>- Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platform to guide NextGen customers (domain teams) on data and analytics implementations<br/><br/>- Design and validate well-architected solutions and plans for productiongrade implementations based on NextGen best practices.<br/><br/>- Discover new use case patterns that are emerging within various Domains and convert them to technical capability requirements and incorporate it back in the NextGen platform.<br/><br/><b>Development & Production Deployment : </b><br/><br/></p><p>- Implement and operationalize data pipelines using Delta Live Tables (DLT) while ensuring production readiness.<br/><br/>- Develop and sustain Continuous Integration/Continuous Deployment (CI/CD) pipelines for effective code promotion and release management.<br/><br/>- Ensure alignment of implemented solutions with NextGen best practices.<br/><br/><b>Workflows & Serverless : </b><br/><br/></p><p>- Design and manage data and analytics workflows using Databricks Workflows<br/><br/>- Advise on serverless architecture planning and implementation to promote scalability and cost efficiency<br/><br/><b>Programming and Solution Design : <br/></b><br/>- Develop solutions using Python and SQL, ensuring scalability, reliability, and robustness.<br/><br/>- Provide architectural and design oversight for efficient data pipelines, workflows, and data quality practices.<br/><br/><b>Customer Leadership and Advisory : </b><br/><br/>- Serve as an escalation point for technical challenges while ensuring timely resolution.<br/><br/>- Collaborate with cross-functional teams (e.g., Platform Engineering, Domain Teams, Platform Architecture) to define and achieve customer success goals.<br/><br/>- Coach and upskill Domain teams on Databricks capabilities and best practices<br/><br/><b>Documentation and Communication : </b><br/><br/>- Create and present technical stories, architecture designs, and technical documentation<br/><br/><b>Requirements : </b><br/><br/>- Strong hands-on experience with the Databricks platform.<br/><br/>- Strong expertise in using Delta Live Tables (DLT) for building and managing data pipelines.<br/><br/>- Proven track record of operationalizing code through CI/CD pipelines in data engineering contexts.<br/><br/>- Proficiency in Python and SQL programming<br/><br/>- Familiarity with Databricks Workflows and/or serverless implementations<br/><br/>- Demonstrated experience in data solution architecture with scalable and maintainable designs.<br/><br/><b>Additional Qualifications : </b><br/><br/>- Experience working with stakeholders to understand business requirements, deduct business needs from existing technical implementation and deliver solutions tailored to business needs<br/><br/>- Excellent problem-solving skills and the ability to adapt to various domain team environments quickly</p> (ref:hirist.tech)