Experience: 5–10 Years
Location: Pan India
Joining Time: Immediate to 15 Days Maximum
Indus Net Technologies is looking for an experienced Data Engineer to design, build, and maintain robust data pipelines leveraging Databricks and Azure Cloud Services .
The ideal candidate will have hands-on expertise in processing large-scale IoT sensor data from manufacturing equipment, ensuring data quality, integrity, and high performance across multi-plant operations.
Design and implement ETL/ELT pipelines using Databricks and PySpark .
Process and transform real-time IoT sensor data from multiple manufacturing plants.
Manage data storage, versioning, and optimization using Delta Lake .
Integrate data from diverse sources (SQL Server, JSON, CSV, APIs, etc.).
Write and optimize complex SQL queries and stored procedures for performance.
Implement data quality monitoring , testing, and CI/CD pipelines using Azure DevOps .
Collaborate closely with manufacturing and analytics teams to deliver actionable IoT data insights.
Databricks & Apache Spark (PySpark) – Minimum 3 years of hands-on experience
Azure Cloud Services – Experience with ADF, Blob Storage, and DevOps
Python – Advanced proficiency with OOP concepts, pandas, and robust error handling
Delta Lake – Strong knowledge of data versioning, time travel, and optimization
Advanced SQL and stored procedure development
Experience in JSON data processing and schema handling
Git-based version control and CI/CD integration using Azure DevOps
Exposure to manufacturing or industrial IoT data patterns
Industrial IoT and time-series data management
Machine data and equipment performance monitoring
Multi-plant data integration and central data architecture
Data quality frameworks , downtime, and defect analytics
Bachelor’s degree in Computer Science , Engineering , or a related field
4–6 years of proven experience in Data Engineering
2+ years of strong exposure to Databricks/Spark ecosystem
Azure Data Engineer Associate or Databricks certification is preferred
Excellent communication skills in English (written and verbal)
Strong analytical and problem-solving mindset
Collaborative and proactive approach with cross-functional teams
High attention to detail and commitment to data accuracy