Big Data Engineer - ETL/Scala/Hadoop

<p><p><b>Description :</b><br/><br/><b>Job Opening :</b> Big Data Engineer (7-10 yrs)<br/><br/><b>Location :</b> Aundh, Pune (Work From Office)<br/><br/><b>Job Type :</b> Full-Time | General Shift | Monday Friday<br/><br/><b>Key Responsibilities :</b></p><p><p><b><br/></b></p>- Build and manage highly scalable Big Data pipelines for large structured datasets.<br/><br/>- Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.<br/><br/>- Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.<br/><br/>- Develop distributed data processing systems using Spark, Akka, or similar frameworks.<br/><br/>- Review, optimize, and enhance existing data pipelines to resolve bottlenecks.<br/><br/>- Act as a Senior Individual Contributor by taking ownership of features/modules.<br/><br/>- Troubleshoot production issues and ensure seamless data flow.<br/><br/>- Work with US & India engineering teams to build and scale Java/Scala-based data pipelines.<br/><br/>- Lead technical excellence in the India engineering team and ensure delivery quality.<br/><br/>- Follow Agile practices and use tools such as JIRA, Git, Gradle/Maven/SBT for development & issue tracking.<br/><br/><b>Must-Have Skills :</b><br/><br/></p><p>- Coding expertise Strong programming & database skills.<br/><br/>- SQL Hands-on experience.<br/><br/>- Scala, PySpark, Cloud (AWS/Azure).<br/><br/>- Data Lake, Snowflake.<br/><br/>- Proven experience in building products from scratch.<br/><br/>- Strong background in Java or Scala, OOP, data structures, algorithms, profiling, and optimization.<br/><br/>- Experience with ETL/Data pipeline tools (Apache NiFi, Airflow, etc.).<br/><br/>- Hands-on with version control (Git) and build tools (Gradle, Maven, SBT).<br/><br/><b>Preferred Experience :</b><br/><br/></p><p>- 7+ years of overall experience, with 57 years of relevant Big Data experience.<br/><br/>- 3+ years in designing & developing scalable Big Data pipelines.<br/><br/>- Experience with frameworks like Spark, Akka, Storm, Hadoop.<br/><br/>- Exposure to cloud platforms (AWS/Azure) for data engineering workloads.<br/><br/><b>Soft Skills :</b><br/><br/></p><p>- Strong communication skills (verbal & written).<br/><br/>- Ability to work independently and collaboratively with global teams.<br/><br/>- High sense of urgency with attention to accuracy & timeliness.<br/><br/>- Capable of handling client interactions and resolving issues under pressure.<br/><br/>- Proactive learner with strong problem-solving abilities.</p><br/></p> (ref:hirist.tech)