Big Data Engineer (Spark | AWS | Scala/Java)

Role: Big Data Engineer
Position Type: Full-Time Contract (40hrs/week)
Contract Duration: Long Term
Work Schedule : 8 hours/day (Mon-Fri)
Location : Hybrid - Hyderabad, India (3x days onsite/week)
We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team.

You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.
Key Responsibilities:
Build and maintain scalable data pipelines with Spark/PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
Develop and integrate RESTful APIs and AWS Gateway services using Scala/Java .
Ensure data quality, performance, and reliability across platforms.
Collaborate with cross-functional teams and support CI/CD deployment processes.
Must-Haves:
5+ years of experience in Big Data Engineering.
Strong skills in Spark/PySpark, Hadoop, AWS (EMR, EC2, ECS) .
Proficiency in Scala/Java for backend/API development.
Solid understanding of RESTful APIs and Git/CI/CD pipelines.
Nice-to-Haves:
Experience in data security, real-time processing, and data lake architectures .
Familiarity with Docker/Kubernetes .