Big Data Engineer (Spark | AWS | Scala/Java)

Role:

Big Data Engineer Position Type:

Full-Time Contract (40hrs/week) Contract Duration:

Long Term Work Schedule : 8 hours/day (Mon-Fri) Location : Hybrid - Hyderabad, India (3x days onsite/week)

We are looking for a skilled

Big Data Engineer (5+ years’ experience)

to join Experian’s dynamic data engineering team.

You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.

Key Responsibilities: Build and maintain scalable data pipelines with

Spark/PySpark, Hadoop, and AWS (EMR, EC2, ECS) .

Develop and integrate

RESTful APIs

and AWS Gateway services using

Scala/Java .

Ensure

data quality, performance, and reliability

across platforms.

Collaborate with cross-functional teams and support

CI/CD deployment

processes.

Must-Haves: 5+ years of experience in Big Data Engineering.

Strong skills in

Spark/PySpark, Hadoop, AWS (EMR, EC2, ECS) .

Proficiency in

Scala/Java

for backend/API development.

Solid understanding of

RESTful APIs

and Git/CI/CD pipelines.

Nice-to-Haves: Experience in

data security, real-time processing, and data lake architectures .

Familiarity with

Docker/Kubernetes .