We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.
Job Location: Greater Noida & Hyderabad Only.
Experience: 5 to 7 Years
Employment Type: Full-Time
Send your updated CV to gaurav.2.kumar@coforge.com
For queries, WhatsApp: 9667427662
If you are a data enthusiast with a passion for building scalable, high-performance data solutions, consider joining us.
This role offers the opportunity to work with cutting-edge technologies in a collaborative and innovative environment.
Key Responsibilities:
- Design and develop high-volume, mission-critical data engineering solutions.
- Enhance applications to meet business and audit requirements.
- Optimize Spark jobs for large-scale data processing.
- Collaborate with onshore and offshore teams to ensure platform availability.
- Participate in the full development lifecycle: coding, testing, and release.
- Support weekend release activities and resolve application issues.
Must-Have Skills:
- Strong hands-on experience with Python and PySpark.
- Proficiency in Spark DataFrames, Jupyter Notebook, and PyCharm.
- Experience with AWS services: EMR, Athena, Glue, Lambda, EC2, S3, SNS.
- Familiarity with ETL processes, handling various file formats (CSV, JSON, XML, etc.).
- Knowledge of data warehousing concepts and columnar storage formats (Parquet, Avro, ORC).
- Version control using Git and CI/CD with Jenkins.
- Awareness of DevOps and automated release pipelines.
Good to Have:
- Experience with AWS databases (Aurora, RDS, Redshift, DynamoDB).
- Exposure to BFSI domain and API Gateway platforms.
- Knowledge of front-end frameworks.
- Experience working with US clients.