Position - Sr. DevOps Engineer
Location - Pune
Experience - 7+ Years
AWS EMR exp is non negotiable.
Roles & Responsibilities:
- Responsible for building and managing our cloud infrastructure (AWS) with a first mindset code.
- Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake
- Performance tune data pipelines using technologies such as Apache Spark, Hive and Trino
- Write and maintain high-quality code and participate in design discussions and code reviews.
- Implement data storage solutions such as S3, ERDS and NoSQL databases.
- Automate workflows using orchestration systems like airflow, oozie etc.
- Build monitoring and observability dashboards.
- Cost optimization and management.
- Enforce security (create and maintain users and roles, assign privileges), establish procedures to ensure data integrity and availability.
- Perform on-call duties to keep the lights up 24x7
- Setup and maintain documentation and standards.
Must have skills:
- 5+ years of experience on public cloud such as AWS (preferred)
- Solid Scripting skills in Java or Python and Shell
- Hands-on with Infrastructure as Code tools like Terraform or CloudFormation.
- Experience with performance diagnostics, debugging and performance tuning.
- Familiarity with container software & platforms like Kubernetes, ECS etc.
- Excellent verbal, written, and interpersonal communication skills.
Education:
Bachelor’s degree in computer science, Software Engineering, MIS, or equivalent combination of education and experience.