Senior Data Engineer – Big Data & AWS (Python + PySpark)

We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.

Job Location: Greater Noida & Hyderabad Only.

Experience: 5 to 7 Years

Employment Type: Full-Time

Send your updated CV to

For queries, WhatsApp:

If you are a data enthusiast with a passion for building scalable, high-performance data solutions, consider joining us.

This role offers the opportunity to work with cutting-edge technologies in a collaborative and innovative environment.

Key Responsibilities:

- Design and develop high-volume, mission-critical data engineering solutions.

- Enhance applications to meet business and audit requirements.

- Optimize Spark jobs for large-scale data processing.

- Collaborate with onshore and offshore teams to ensure platform availability.

- Participate in the full development lifecycle: coding, testing, and release.

- Support weekend release activities and resolve application issues.

Must-Have Skills:

- Strong hands-on experience with Python and PySpark.

- Proficiency in Spark DataFrames, Jupyter Notebook, and PyCharm.

- Experience with AWS services: EMR, Athena, Glue, Lambda, EC2, S3, SNS.

- Familiarity with ETL processes, handling various file formats (CSV, JSON, XML, etc.).

- Knowledge of data warehousing concepts and columnar storage formats (Parquet, Avro, ORC).

- Version control using Git and CI/CD with Jenkins.

- Awareness of DevOps and automated release pipelines.

Good to Have:

- Experience with AWS databases (Aurora, RDS, Redshift, DynamoDB).

- Exposure to BFSI domain and API Gateway platforms.

- Knowledge of front-end frameworks.

- Experience working with US clients.