Senior Data Engineer - Python/SQL/ETL

<p><p><b>Job Title</b> : Senior Data Engineer<br/><br/><b>Experience</b> : 5 to 7 Years<br/><br/><b>Location</b> : Hyderabad <br/><br/><b>Key Responsibilities</b> : <br/><br/>- Design, develop, and maintain robust data pipelines using AWS Glue, PySpark, and Python.<br/><br/>- Build scalable and efficient ETL/ELT workflows and manage metadata using Glue Data Catalog.<br/><br/>- Optimize data models, partitioning strategies, and query performance for large-scale data lakes.<br/><br/>- Implement and maintain cloud-native data solutions using AWS services like S3, Lambda, Aurora PostgreSQL, RDS, IAM, and EC2.<br/><br/>- Develop infrastructure as code using Terraform for reproducible, scalable infrastructure.<br/><br/>- Collaborate with cross-functional teams in an agile environment to deliver high-quality data products.<br/><br/>- Work with modern data lake frameworks including AWS Data Lake, Apache Iceberg, and Lake Formation.<br/><br/>- Ensure data governance, security, and performance tuning across data systems.<br/><br/>- Support CI/CD and DevOps best practices for deploying data solutions.<br/><br/><b>Required Skills & Qualifications : </b><br/><br/>- Bachelors degree in Computer Science, Engineering, or a related field.<br/><br/>- 5 to 7 years of experience in Data Engineering or related roles.<br/><br/>- Deep expertise in AWS cloud ecosystem, especially Glue, S3, Lambda, EC2, Aurora PostgreSQL, RDS, and IAM.<br/><br/>- Proficient in Python and PySpark for large-scale data processing.<br/><br/>- Strong understanding of SQL, data modelling, and performance optimization techniques.<br/><br/>- Hands-on experience with Terraform and infrastructure automation.<br/><br/>- Experience with AWS Data Lake, Lake Formation, and Apache Iceberg.<br/><br/>- Good understanding of DevOps principles and experience with CI/CD pipelines.<br/><br/>- Excellent problem-solving skills and ability to work in fast-paced, agile environments.<br/><br/>- Strong verbal and written communication skills.<br/><br/><b>Good to Have : </b><br/><br/>- AWS certification (e.g., AWS Certified Data Analytics, Solutions Architect).<br/><br/>- Experience with data quality frameworks or monitoring tools.<br/><br/>- Exposure to streaming data tools like Kinesis or Kafka.</p><br/></p> (ref:hirist.tech)