Roles & Responsibilities
- Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment
- Participate in design and implementation of the analytics architecture.
- Experience in working on Hadoop Distribution, good understanding of core concepts and best practices
- Good experience in building/tuning Spark pipelines in Python/Java/Scala
- Good experience in writing complex Hive queries to drive business critical insights
- Understanding of Data Lake vs Data Warehousing concepts
- Experience with AWS Cloud, exposure to Lambda/EMR/Kinesis will be good to have.
Skills Required
Azure Databricks, Databricks, Notebooks