Big Data Engineer (Spark | AWS | Scala/Java)

Role:

Big Data Engineer
Position Type:

Full-Time Contract (40hrs/week)
Contract Duration:

Long Term
Work Schedule : 8 hours/day (Mon-Fri)
Location : Hybrid - Hyderabad, India (3x days onsite/week)

We are looking for a skilled

Big Data Engineer (5+ years’ experience)

to join Experian’s dynamic data engineering team.

You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities:
Build and maintain scalable data pipelines with

Spark/PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
Develop and integrate

RESTful APIs

and AWS Gateway services using

Scala/Java .
Ensure

data quality, performance, and reliability

across platforms.
Collaborate with cross-functional teams and support

CI/CD deployment

processes.

Must-Haves:
5+ years of experience in Big Data Engineering.
Strong skills in

Spark/PySpark, Hadoop, AWS (EMR, EC2, ECS) .
Proficiency in

Scala/Java

for backend/API development.
Solid understanding of

RESTful APIs

and Git/CI/CD pipelines.

Nice-to-Haves:
Experience in

data security, real-time processing, and data lake architectures .
Familiarity with

Docker/Kubernetes .