Senior Data Engineer - AWS/Python

<p><p><b>Job Description :</b><br/><br/>We are looking for a highly skilled Senior Data Engineer with strong expertise in AWS, Python, and PySpark to join our team.<br/><br/><b>Key Responsibilities :</b><br/><br/>- Build scalable PySpark applications using Spark DataFrames in Python.<br/><br/></p><p>- Optimize Spark jobs for large-scale data processing.<br/><br/></p><p>- Work with AWS analytics services : EMR, Athena, Glue.<br/><br/></p><p>- Work with AWS compute/storage services : Lambda, EC2, S3, SNS.<br/><br/></p><p>- Collaborate with cross-functional teams to design and implement efficient data pipelines.<br/><br/></p><p>- Maintain codebase using Git or other version control systems.<br/><br/></p><p>- Ensure data quality, performance tuning, and process improvements.<br/><br/><b>Required Skills :</b><br/><br/>- 5+ years of IT experience, with hands-on in Big Data technologies.<br/><br/></p><p>- Strong expertise in Python and PySpark.<br/><br/></p><p>- Practical experience with data compression & storage formats : Parquet, Avro, ORC, Snappy, Gzip.<br/><br/></p><p>- Good understanding of data warehousing concepts dimensions, facts, schemas (snowflake, star).<br/><br/><b>Good to Have :</b><br/><br/>- Knowledge of AWS databases such as Aurora, RDS, Redshift, ElastiCache, DynamoDB.</p><br/></p> (ref:hirist.tech)