Info Services - Senior Data Engineer - Python/SQL/ETL

<p><p><b>Note : If shortlisted, you will be invited for initial rounds on 8th November'25 (Saturday) in : </b></p><br/><p>- Migrate and optimize existing data pipelines from Snowflake to Databricks.</p><br/><p>- Develop and maintain efficient ETL workflows using PySpark and SQL.</p><br/><p>- Design scalable and performance-optimized data processing solutions in Databricks.</p><br/><p>- Troubleshoot and resolve data pipeline issues, ensuring accuracy and reliability.</p><br/><p>- Work independently to analyze requirements, propose solutions, and implement them effectively.</p><br/><p>- Collaborate with stakeholders to understand business requirements and ensure a seamless transition.</p><br/><p>- Optimize Spark performance tuning for large-scale data processing.</p><br/><p>- Maintain proper documentation for migrated pipelines and workflows.</p><br/><p><b>Required Qualifications : </b></p><br/><p>- Proficiency in Python, SQL, and Apache Spark (PySpark preferred).</p><br/><p>- Experience with Databricks and Snowflake, including pipeline development and optimization.</p><br/><p>- Strong understanding of ETL processes, data modeling, and distributed computing.</p><br/><p>- Ability to work independently and manage multiple tasks in a fast-paced environment.</p><br/><p>- Hands-on experience with orchestration tools (e.g., Airflow, Databricks Workflows).</p><br/><p>- Familiarity with cloud platforms (AWS) is a plus.</p><br/></p> (ref:hirist.tech)