Looking for Senior Software Development Engineer, you will leverage your 5+ years of expertise in Python-driven data engineering, cloud platforms (AWS & GCP), and distributed systems to architect and deliver scalable data solutions.
You will be a key contributor to building and maintaining large-scale data warehouses, event-driven data pipelines, and microservices that power mission-critical business processes.
Your role also encompasses developing RESTful APIs, automating CI/CD pipelines, and working closely with ML teams on model deployment and data integration.
Key Responsibilities
- Architect, develop, and maintain scalable, event-driven data pipelines and microservices using Python (Flask, FastAPI, Django).
- Manage and optimize large-scale data warehouses leveraging SQL, BigQuery, Redshift, and cloud-native data services.
- Build robust ETL solutions and streaming data processors using Spark, Apache Kafka, and cloud services.
- Design and implement infrastructure as code (IaC) and automated CI/CD pipelines for rapid deployment on cloud environments.
- Containerize and orchestrate applications with Docker and Kubernetes to ensure scalability and reliability.
- Collaborate cross-functionally with analytics, ML, and product teams to transform business requirements into technical architectures.
- Develop dashboards and data visualization tools with SQL and front-end frameworks (Angular preferred).
- Implement metrics, alerts, and automated error handling to monitor and continually improve system health and performance.