Python API + Data Engineer

Experience: 5 to 8 years

Job description: Python API + Data Engineer

We are looking for a self-motivated Python Data Engineer with strong skills in backend/API development and large-scale data processing, who can work independently and thrive in a fast-paced, agile environment.

Key Responsibilities

- Design, develop, and optimize data pipelines using PySpark, AWS Glue, and EMR.

- Build and maintain Python backend/API services (FastAPI, async preferred).

- Support ML/MLOps workflows leveraging AWS SageMaker and other cloud-native tools.

- Write clean, testable, and scalable code with unit testing (pytest) and CI/CD practices.

- Work with AWS services (S3, Athena, Glue, EMR, SageMaker) for data engineering and model deployment.

- Collaborate cross-functionally to provide production support, troubleshooting, and performance optimization.

- Use modern DevOps tools (Git, Docker, Kubernetes, Terraform) to automate deployments and ensure reliability.

- Communicate effectively with global teams and adapt quickly to changing requirements.

Required Skills & Experience

- Strong expertise in Python programming.

- Hands-on experience with PySpark and large-scale data processing.

- Proven experience in Python API/backend development (FastAPI, REST/async).

- Proficiency in AWS cloud services: Glue, EMR, SageMaker, S3, Athena.

- Exposure to ML/MLOps workflows and production-level deployment.

- Solid knowledge of SQL/PostgreSQL and database query optimization.

- Familiarity with unit testing (pytest), Git, Docker, Kubernetes, Terraform.

- Strong problem-solving, production support, and communication skills.

Work Environment

- Remote-friendly, with expectation of independent ownership and accountability.

- Timing: 2 PM - 11 PM IST ( 4 hours overlap with EST)