Data Engineer - ETL/Azure Databricks

<p><p><b>Job Title</b> Data Engineer<br/><br/><b>Location</b> Bangalore (Hybrid)<br/><br/><b>Interview Mode </b>- Video <br/><br/><b>Duration </b>: 6 Months Contract to hire/Full Time<br/><br/><b>Core Responsibilities :</b><br/><br/>- Data Architecture & Strategy<br/><br/></p><p>- Define enterprise-wide data models, standards, and integration patterns.<br/><br/></p><p>- Build data platforms on cloud/on-prem (Azure, AWS, GCP, Databricks, Snowflake, etc.).<br/><br/></p><p>- Establish guidelines for scalability, security, and cost optimization.<br/><br/>- Data Pipeline & Integration<br/><br/></p><p>- Design high-performance ETL/ELT pipelines.<br/><br/></p><p>- Implement real-time streaming (Kafka, Kinesis, Pub/Sub) and batch processing.<br/><br/></p><p>- Enable interoperability across operational, analytical, and AI systems.<br/><br/>- Governance & Quality<br/><br/></p><p>- Ensure compliance with data regulations (GDPR, HIPAA, SAMA, etc.).<br/><br/></p><p>- Build frameworks for metadata management, lineage, and observability.<br/><br/></p><p>- Work closely with Data Quality Management and Master Data Management (MDM).<br/><br/>- Collaboration<br/><br/></p><p>- Partner with business stakeholders to translate use cases into technical designs.<br/><br/></p><p>- Guide data engineers, analysts, and scientists on best practices.<br/><br/></p><p>- Align with enterprise architects and solution architects.<br/><br/>- Innovation & Future-Readiness<br/><br/></p><p>- Evaluate new technologies (e.g., lakehouse, vector databases, RAG).<br/><br/></p><p>- Architect solutions for AI/ML enablement.<br/><br/></p><p>- Drive automation and adoption of agentic AI in data workflows.<br/><br/><b>Typical Skill Set :</b><br/><br/>- Tech Foundations: SQL, Python/Scala/Java, distributed systems.<br/><br/></p><p>- Cloud & Data Platforms: Azure Synapse, AWS Redshift, GCP BigQuery, Snowflake, Databricks, Hadoop/Spark.<br/><br/></p><p>- Data Modeling: OLTP, OLAP, dimensional modeling, Data Vault, Knowledge Graphs.<br/><br/></p><p>- Integration Tools: Informatica, Talend, dbt, Airflow, Kafka.<br/><br/></p><p>- Architecture Practices: TOGAF, microservices, event-driven design.<br/><br/></p><p>- Soft Skills: Stakeholder management, solutioning, and leadership<br/></p><br/></p> (ref:hirist.tech)