We are seeking an experienced Senior Python Developer who specializes in building and maintaining high-performance ETL and data integration pipelines .
This ideal candidate will be working with data from diverse sources, transforming it efficiently, and ensuring seamless downstream delivery to analytics and reporting systems.
You will work with a global delivery team to design scalable, modular, and automated data workflows using modern tools such as Airflow , Git , and Azure Cloud Services .
Key Responsibilities
· Design, develop, and maintain Python-based ETL pipelines to extract data from multiple sources such as APIs, SFTP, and web services.
· Perform data transformation, cleaning, and validation using Python (especially pandas) for analytics and reporting consumption.
· Maintain and extend existing Python codebases - ensuring modularity, reusability, and consistent coding standards.
· Implement workflow orchestration and scheduling using Apache Airflow, including DAG creation, monitoring, and error handling.
· Collaborate with data engineers, operations, and QA teams to ensure pipeline reliability and scalability.
· Use Git for version control and actively participate in peer code reviews, documentation, and repository management.
· Apply best practices in logging, exception handling, and testing for production-ready code.
Required Skills & Experience
· Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
· 6–12 years of professional experience in software development with strong Python expertise.
· Minimum 4+ years in ETL / Data Engineering using Python and pandas.
· Solid understanding of API integrations, SFTP data ingestion, and web data extraction.
· Proficiency in modular programming, OOP concepts, and abstraction-based design.
· Experience with Airflow for workflow management - creating, scheduling, and monitoring DAGs.
· Strong understanding of Git-based workflows, branching strategies, and CI/CD collaboration.
Nice to Have Skills
Soft Skills
· Strong analytical and problem-solving mindset.
· Excellent attention to detail and focus on clean, maintainable code.
· Good communication and collaboration skills for distributed team environments.
· Self-driven, proactive, and comfortable in fast-paced, dynamic projects.