Big Data Engineer

<p><p><b>To be successful in this role, you should possess : </b></p><p><br/></p><p>- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.<br/><br/>- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools<br/>and frameworks required to solve Big Data problems at scale.<br/><br/>- Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools<br/>like Akka and Spark.<br/><br/>- Understanding and critically reviewing existing data pipelines, and coming up with ideas in collaboration with Technical Leaders and Architects to improve upon current bottlenecks<br/><br/>- Take initiatives, and show the drive to pick up new stuff proactively, and work as a Senior Individual contributor on the multiple products and features we have.<br/><br/>- 3+ years of experience in developing highly scalable Big Data pipelines.<br/><br/>- In-depth understanding of the Big Data ecosystem including processing frameworks like Spark, Akka, Storm,and Hadoop, and the file types they deal with.<br/><br/>- Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.<br/><br/>- Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required.<br/><br/>- Experience with Git and build tools like Gradle/Maven/SBT.<br/><br/>- Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.<br/><br/>- Have elegant, readable, maintainable and extensible code style.<br/><br/><b>You are someone who would easily be able to :</b><br/><br/>- Work closely with the US and India engineering teams to help build the Java/Scala based data pipelines<br/><br/>- Lead the India engineering team in technical excellence and ownership of critical modules; own the development of new modules and features<br/><br/>- Troubleshoot live production server issues.<br/><br/>- Handle client coordination and be able to work as a part of a team, be able to contribute independently and drive the team to exceptional contributions with minimal team supervision<br/><br/>- Follow Agile methodology, JIRA for work planning, issue management/tracking</p><br/></p> (ref:hirist.tech)