Job Description
<p><p>We are seeking a highly motivated and experienced DevOps Engineer to join our growing team.
</p><p><br/></p><p>As a DevOps Engineer, you will play a crucial role in designing, implementing, and maintaining our cloud infrastructure and CI/CD pipelines, with a focus on AWS cloud technologies, big data solutions, and Jenkins automation.
</p><p><br/></p><p>You will work closely with development and operations teams to ensure smooth and efficient software delivery, scalability, and reliability with a strong emphasis on security best practices.<br/><br/><b>Responsibilities :</b></p><p><p><b><br/></b></p>- Design, implement, and manage AWS cloud infrastructure using services like EC2 S3 VPC, IAM, Lambda, ECS, EKS, EMR and AWS Backup.<br/><br/>- Implement and manage infrastructure as code (IaC) using tools like Terraform or CloudFormation.<br/><br/>- Optimise cloud costs and performance.<br/><br/>- Ensure high availability and disaster recovery for cloud resources.<br/><br/>- Implement robust backup and recovery strategies using AWS Backup.<br/><br/>- Design, implement, and maintain CI/CD pipelines using Jenkins.<br/><br/>- Automate build, test, and deployment processes.<br/><br/>- Integrate various DevOps tools into the pipeline (e.
g., code analysis, security scanning, artefact repositories).<br/><br/>- Implement and manage containerization technologies like Docker and Kubernetes.<br/><br/>- Implement and enforce security best practices across all infrastructure and applications.<br/><br/>- Configure security groups, network ACLs, and IAM roles to control access to resources.<br/><br/>- Implement security monitoring and alerting to detect and respond to threats.<br/><br/>- Ensure compliance with security standards and regulations.<br/><br/>- Integrate security tools and services into the CI/CD pipeline.<br/><br/>- Implement monitoring and logging solutions to track system health, performance, and security.<br/><br/>- Utilise tools like CloudWatch, Prometheus, Grafana, and ELK stack.<br/><br/>- Analyse logs and metrics to identify and resolve issues proactively.<br/><br/>- Work closely with development and operations teams to ensure seamless software delivery.<br/><br/>- Participate in agile development processes and sprint planning.<br/><br/>- Clearly communicate technical solutions and challenges to stakeholders.<br/><br/>- Design and implement data pipelines for ingestion, processing, and storage of large datasets using EMR clusters.<br/><br/>- Optimise big data infrastructure for performance and scalability, including tuning EMR clusters and Spark applications.<br/><br/><b>Requirements :</b></p><p><p><b><br/></b></p>- Experience working with big data technologies such as Hadoop, Spark, Hive, Presto, and managing them on AWS EMR.<br/><br/>- Experience with EMR cluster configuration, security, and monitoring.<br/><br/>- 1+ years of experience as a DevOps Engineer or similar role.<br/><br/>- Strong understanding of AWS cloud services and best practices, including security best practices.<br/><br/>- Hands-on experience with IaC tools like Terraform or CloudFormation.<br/><br/>- Proficiency in Jenkins pipeline development and automation.<br/><br/>- Experience with containerization technologies (Docker, Kubernetes).<br/><br/>- Familiarity with big data technologies (Hadoop, Spark, Hive, Presto).<br/><br/>- Strong experience with AWS EMR, including cluster management, performance optimisation, and security.<br/><br/>- Experience with AWS Backup and implementing backup and recovery strategies.<br/><br/>- Experience with monitoring and logging tools (CloudWatch, Prometheus, Grafana, ELK).<br/><br/>- Strong scripting skills (Bash, Python).<br/><br/>- Excellent communication and collaboration skills.<br/><br/>- Experience with configuration management tools (Ansible, Chef, Puppet).<br/><br/>- Knowledge of security best practices in cloud environments.<br/><br/>- Experience with serverless computing.<br/><br/>- AWS Certified DevOps Engineer is preferable.<br/><br/>- Experience in Azure / GCP.</p><br/></p> (ref:hirist.tech)