AWS/API Gateway Pipeline Engineer

<p><p><b>AWS Data/API Gateway Pipeline Engineer</b> responsible for designing, building, and maintaining real-time, serverless data pipelines and API services.<br/><br/> This role requires extensive hands-on experience with Java, Python, Redis, DynamoDB Streams, and PostgreSQL, along with working knowledge of AWS Lambda and AWS Glue for data processing and orchestration.<br/><br/>This position involves collaboration with architects, backend developers, and DevOps engineers to deliver scalable, event-driven data solutions and secure API services across cloud-native systems.<br/><br/><b>Key Responsibilities :</b><br/><br/><b>API & Backend Engineering :</b><br/><br/></p><p>- Build and deploy RESTful APIs using AWS API Gateway, Lambda, and Java and Python.<br/><br/></p><p>- Integrate backend APIs with Redis for low-latency caching and pub/sub messaging.<br/><br/></p><p>- Use PostgreSQL for structured data storage and transactional processing.<br/><br/></p><p>- Secure APIs using IAM, OAuth2, and JWT, and implement throttling and versioning strategies.<br/><br/><b>Data Pipeline & Streaming :</b><br/><br/></p><p>- Design and develop event-driven data pipelines using DynamoDB Streams to trigger downstream processing.<br/><br/></p><p>- Use AWS Glue to orchestrate ETL jobs for batch and semi-structured data workflows.<br/><br/></p><p>- Build and maintain Lambda functions to process real-time events and orchestrate data flows.<br/><br/></p><p>- Ensure data consistency and resilience across services, queues, and databases.<br/><br/><b>Cloud Infrastructure & DevOps :</b><br/><br/></p><p>- Deploy and manage cloud infrastructure using CloudFormation, Terraform, or AWS CDK.<br/><br/></p><p>- Monitor system health and service metrics using CloudWatch, SNS and structured logging.<br/><br/></p><p>- Contribute to CI/CD pipeline development for testing and deploying Lambda/API services.<br/><br/><b>Required Skills and Experience :</b><br/><br/></p><p>- Bachelor's degree in computer science, Engineering, or a related field.<br/><br/></p><p>- Over 6 years of experience in developing backend or data pipeline services using Java and Python.<br/><br/></p><p>- Strong hands-on experience with:<br/><br/></p><p>- AWS API Gateway, Lambda, DynamoDB Streams<br/><br/></p><p>- Redis (caching, messaging)<br/><br/></p><p>- PostgreSQL (schema design, tuning, SQL)<br/><br/></p><p>- AWS Glue for ETL jobs and data transformation<br/><br/></p><p>- Solid understanding of REST API design principles, serverless computing, and real-time architecture.<br/><br/><b>Preferred Skills and Experience :</b><br/><br/></p><p>- Familiarity with Kafka, Kinesis, or other message streaming systems<br/><br/></p><p>- Swagger/OpenAPI for API documentation<br/><br/></p><p>- Docker and Kubernetes (EKS)<br/><br/></p><p>- Git, CI/CD tools (e.g., GitHub Actions)<br/><br/></p><p>- Experience with asynchronous event processing, retries, and dead-letter queues (DLQs)<br/><br/></p><p>- Exposure to data lake architectures (S3, Glue Data )</p><br/></p> (ref:hirist.tech)