Big Data Engineer - Hadoop/Spark/Hive

<p><p><b>Job Title :</b> Big Data Engineer<br/><br/><b>Location :</b> Bangalore / Pune<br/><br/><b>Employment Type :</b> Full Time<br/><br/><b>Experience :</b> 4 to 8 years<br/><br/><b>Notice Period :</b> 15 days<br/><br/><b>About the Role :</b><br/><br/>We are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data processing systems.

The ideal candidate will have hands-on experience with big data technologies and a strong ability to build scalable and high-performance data pipelines.<br/><br/><b>Key Responsibilities :</b><br/><br/>- Design and implement big data pipelines and ETL processes using Hadoop, Spark, Hive, and Kafka.<br/><br/>- Develop and maintain data ingestion, processing, and storage frameworks for high-volume datasets.<br/><br/>- Optimize and tune big data applications for performance and scalability.<br/><br/>- Work closely with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.<br/><br/>- Ensure data quality, security, and compliance with industry best practices.<br/><br/>- Monitor, troubleshoot, and resolve issues in production big data environments.<br/><br/><b>Required Skills & Qualifications :</b><br/><br/>- 4 to 8 years of experience in big data engineering or related roles.<br/><br/>- Strong expertise in Hadoop ecosystem : HDFS, YARN, MapReduce.<br/><br/>- Hands-on experience with Apache Spark, Hive, and Kafka.<br/><br/>- Proficiency in SQL and at least one programming language (Java/Scala/Python).<br/><br/>- Good understanding of data modeling, distributed computing, and performance tuning.<br/><br/>- Experience with real-time data streaming and batch processing.<br/><br/>- Strong problem-solving skills and ability to work in a fast-paced environment.<br/><br/><b>Good to Have :</b><br/><br/>- Experience with cloud platforms (AWS, Azure, or GCP) and big data services.<br/><br/>- Knowledge of data lake architectures, NoSQL databases (HBase, Cassandra, etc.).<br/><br/>- Familiarity with containerization (Docker, Kubernetes).<br/><br/><b>Why Join Us :</b><br/><br/>- Opportunity to work on cutting-edge big data technologies and large-scale projects.<br/><br/>- Collaborative work culture and exposure to challenging data engineering problems.<br/><br/>- Competitive salary and growth opportunities in a rapidly evolving data-driven industry.</p><br/></p> (ref:hirist.tech)