<p><p><b>Exciting Job Opportunity in Pune!</b><br/><br/>Are you an experienced Senior Big Data Engineer with over 5 years of expertise?
We have a fantastic opportunity waiting for you!<br/><br/><b>Key Requirements :</b><br/><br/>- Minimum of 5+ years of experience<br/></p><p><br/></p><p>- Proficient in Spark development for batch and streaming applications<br/></p><p><br/></p><p>- Skilled in Pyspark and Data Engineering<br/></p><p><br/></p><p>- Expert in ETL implementation and migration to Spark<br/></p><p><br/></p><p>- Strong programming skills in Scala, Java, and Python<br/></p><p><br/></p><p>- Hands-on experience with Kafka and Spark streaming (Dstream and Structured Streaming)<br/></p><p><br/></p><p>- Familiar with developer tools like Jupyter notebooks<br/></p><p><br/></p><p>- Knowledgeable about Airflow or similar workflow engines<br/><br/><b>Desirable Skills :</b><br/><br/>- Exposure to Flink and Kudu streaming<br/></p><p><br/></p><p>- Workflow automation using CI/CD practices<br/></p><p><br/></p><p>- Understanding of Nifi streaming and transformation<br/></p><p><br/></p><p>- Experience with Informatica workflow migration</p><br/></p> (ref:hirist.tech)