Data Engineering Manager – Python & AI
Experience: 7 to 12 Years
Location: Remote (Work from Home) / Bangalore / India
Mode of Engagement: Full-time
No of Positions: 2
Educational Qualification: MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT
Industry: IT / Data / AI / E-commerce / FinTech / Healthcare
Notice Period: Immediate
What We Are Looking For:
- 7–12 years of experience in managing end-to-end data engineering and delivery projects, including Python-based data scraping, ETL, and dashboarding.
- Proven experience in leading teams, setting up complex data engineering projects, and establishing data pipelines integrating scraping, processing, and analytics.
- Hands-on proficiency in Python, SQL, ETL frameworks, and web scraping, with working knowledge of AI tools and automation frameworks like LangChain, LlamaIndex, or AutoGen.
- Experience with AWS, GitHub, CI/CD, Jira, ClickUp, and DevOps tools for delivery tracking, workflow automation, and performance optimization.
Responsibilities:
- Lead and manage multiple data engineering and AI-enabled delivery projects, ensuring scalability, performance, and high-quality outcomes.
- Architect and implement data pipelines and scraping systems using Python, Pandas, BeautifulSoup, or Scrapy, integrating AI-based automation where applicable.
- Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to design, build, and optimize large-scale data systems and dashboards.
- Drive automation and AI adoption across projects to improve efficiency in scraping, transformation, and reporting workflows.
- Work closely with clients across IT, FinTech, E-commerce, and Healthcare domains to understand technical needs, plan delivery schedules, and ensure data integrity.
- Establish and monitor data quality, governance, and compliance standards throughout project execution.
- Mentor and guide team members on Python best practices, AI frameworks, and data engineering design patterns.
- Manage project timelines, status reporting, and delivery metrics using Jira, ClickUp, and CI/CD pipelines.
Qualifications:
- Bachelor's or master's degree in engineering, Computer Science, or related field.
- Strong hands-on expertise in Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks.
- Exposure to AI and automation frameworks (LangChain, LlamaIndex, AutoGen) preferred.
- Working knowledge of AWS, GitHub, DevOps (Docker, Kubernetes), and workflow automation tools.
- Proven experience managing cross-functional data delivery teams and handling international client communication.
- Excellent analytical, leadership, and problem-solving skills.
- Project Management certifications (PMP, Agile, or Scrum Master) are an added advantage.