<p><p><b>Job Description :</b></p><p><br/></p><p>We are seeking a highly skilled Big Data Tester with strong expertise in ETL Testing, Hadoop, and Spark/PySpark.
The candidate will be responsible for ensuring data quality, validating large-scale data pipelines, and working closely with data engineers and analysts to deliver reliable big data solutions.<br/><br/><b>Key Responsibilities :</b></p><p><p><b><br/></b></p>- Perform end-to-end testing of big data applications, data pipelines, and ETL workflows.<br/><br/></p><p>- Validate data transformations, aggregations, and data quality across multiple sources and targets.<br/><br/></p><p>- Conduct functional, regression, system integration, and performance testing for big data solutions.<br/><br/></p><p>- Write and execute complex SQL and Hive queries to verify data accuracy and consistency.<br/><br/></p><p>- Collaborate with data engineers and developers to debug and resolve data issues.<br/><br/></p><p>- Design and maintain test plans, test cases, and automation frameworks for big data testing.<br/><br/></p><p>- Perform batch and streaming data validation on Hadoop ecosystem components.<br/><br/></p><p>- Ensure compliance with data governance, quality, and security standards.<br/><br/><p><b>Required Skills & Experience :</b></p><p><b><br/></b></p>- Strong experience in ETL Testing with a solid understanding of data warehousing concepts.<br/><br/></p><p>- Hands-on expertise in Hadoop ecosystem (HDFS, Hive, HBase, Sqoop, etc.).<br/><br/></p><p>- Proficiency in Apache Spark / PySpark for data validation and transformations.<br/><br/></p><p>- Strong SQL skills (Oracle, Teradata, MySQL, or similar) for data validation.<br/><br/></p><p>- Experience with big data testing strategies including volume, performance, and scalability testing.<br/><br/></p><p>- Familiarity with data pipeline orchestration tools (Airflow, Oozie, NiFi, etc.).<br/><br/></p><p>- Exposure to test automation frameworks for big data testing is a plus.<br/><br/></p><p>- Good analytical, debugging, and problem-solving skills.</p><br/></p> (ref:hirist.tech)