Role: Big Data Engineer
Position Type: Full-Time Contract (40hrs/week)
Contract Duration: Long Term
Work Schedule : 8 hours/day (Mon-Fri)
Location : Hybrid - Hyderabad, India (3x days onsite/week)
We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team.
You will design and optimize scalable data pipelines, APIs, and big data solutions on AWS to support our global data ecosystem.
Key Responsibilities:
- Build and maintain scalable data pipelines with Spark/PySpark, Hadoop, and AWS (EMR, EC2, ECS) .
- Develop and integrate RESTful APIs and AWS Gateway services using Scala/Java .
- Ensure data quality, performance, and reliability across platforms.
- Collaborate with cross-functional teams and support CI/CD deployment processes.
Must-Haves:
- 5+ years of experience in Big Data Engineering.
- Strong skills in Spark/PySpark, Hadoop, AWS (EMR, EC2, ECS) .
- Proficiency in Scala/Java for backend/API development.
- Solid understanding of RESTful APIs and Git/CI/CD pipelines.
Nice-to-Haves:
- Experience in data security, real-time processing, and data lake architectures .
- Familiarity with Docker/Kubernetes .