Job description
 
                         Data Engineering Manager – AI & Automation
Experience:  7 to 12 Years
Location:  Remote (Work from Home) / Bangalore / India
Mode of Engagement:  Full-time
No of Positions:  2
Educational Qualification:  MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT
Industry:  IT / Data / AI / E-commerce / FinTech / Healthcare
Notice Period:  Immediate
What We Are Looking For:
7–12 years of experience in managing  end-to-end data engineering and delivery projects , including  Python-based data scraping, ETL, and dashboarding .
Proven experience in  leading teams ,  setting up complex data engineering projects , and establishing  data pipelines  integrating scraping, processing, and analytics.
Hands-on proficiency in  Python, SQL, ETL frameworks , and  web scraping , with working knowledge of  AI tools and automation frameworks  like  LangChain, LlamaIndex, or AutoGen .
Experience with  AWS, GitHub, CI/CD, Jira, ClickUp , and  DevOps tools  for delivery tracking, workflow automation, and performance optimization.
Responsibilities:
Lead and manage multiple  data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.
Architect and implement  data pipelines and scraping systems  using Python, Pandas, BeautifulSoup, or Scrapy, integrating  AI-based automation  where applicable.
Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to  design, build, and optimize  large-scale data systems and dashboards.
Drive  automation and AI adoption  across projects to improve efficiency in  scraping, transformation, and reporting workflows .
Work closely with clients across  IT, FinTech, E-commerce, and Healthcare  domains to understand technical needs, plan delivery schedules, and ensure data integrity.
Establish and monitor  data quality, governance, and compliance  standards throughout project execution.
Mentor and guide team members on  Python best practices, AI frameworks, and data engineering design patterns .
Manage project timelines, status reporting, and delivery metrics using  Jira, ClickUp, and CI/CD pipelines .
Qualifications:
Bachelor's or master's degree in engineering, Computer Science, or related field.
Strong hands-on expertise in  Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .
Exposure to  AI and automation frameworks  (LangChain, LlamaIndex, AutoGen) preferred.
Working knowledge of  AWS ,  GitHub ,  DevOps (Docker, Kubernetes) , and  workflow automation tools .
Proven experience managing  cross-functional data delivery teams  and handling  international client communication .
Excellent analytical, leadership, and problem-solving skills.
Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.
 
                    
                    
Required Skill Profession
 
                     
                    
                    Computer Occupations