Hiring Senior Data Engineer for an IT Product Company
Location :Pune
Role: Senior Data Engineer:
Minimum 4+Yrs of Relevant Experience
Mandatory Skills: Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or Azure cloud
- Master's degree in either software engineering, data engineering, data science, computer science, physics, statistics, mathematics, or a related field
- Data engineering professional experience
- Previous hands-on professional experience in developing and maintaining data pipelines on AWS and Databricks.
- Ability to write compelling code, technical documentation and visualize your technical design.
- Coding proficiency with multiple languages Python, Scala and DBT.
- Fluent in industry-standard DevOps practices.
- Practical experience in working with enterprise data landscapes and data structures: Structural data, non-structural data, metadata, master data, transactional data, batch/NRT.
- Tech stack: AWS, Gitlab, Databricks for ETL, Airflow, Python, Scala, and DBT for developing ETL, jobs, AWS CDK and Terraform for IaC.
- Experience on enterprise data sources: Experience in working with any one of these e.g. SAP ERP, Salesforce and product data management (PDM), manufacturing execution system (MES) system data.
- Exposure in Medallion Lakehouse Architecture Would be a plus