Job Description
Data Engineering Manager – AI & Automation
Experience:
7 to 12 Years
Location:
Remote (Work from Home) / Bangalore / India
Mode of Engagement:
Full-time
No of Positions:
2
Educational Qualification:
MBA / B.E / B.Tech / M.Tech / MCA / Computer Science / IT
Industry:
IT / Data / AI / E-commerce / FinTech / Healthcare
Notice Period:
Immediate
What We Are Looking For:
7–12 years of experience in managing
end-to-end data engineering and delivery projects , including
Python-based data scraping, ETL, and dashboarding .
Proven experience in
leading teams ,
setting up complex data engineering projects , and establishing
data pipelines
integrating scraping, processing, and analytics.
Hands-on proficiency in
Python, SQL, ETL frameworks , and
web scraping , with working knowledge of
AI tools and automation frameworks
like
LangChain, LlamaIndex, or AutoGen .
Experience with
AWS, GitHub, CI/CD, Jira, ClickUp , and
DevOps tools
for delivery tracking, workflow automation, and performance optimization.
Responsibilities:
Lead and manage multiple
data engineering and AI-enabled delivery projects , ensuring scalability, performance, and high-quality outcomes.
Architect and implement
data pipelines and scraping systems
using Python, Pandas, BeautifulSoup, or Scrapy, integrating
AI-based automation
where applicable.
Collaborate with cross-functional teams — Data Engineers, Python Developers, and Analysts — to
design, build, and optimize
large-scale data systems and dashboards.
Drive
automation and AI adoption
across projects to improve efficiency in
scraping, transformation, and reporting workflows .
Work closely with clients across
IT, FinTech, E-commerce, and Healthcare
domains to understand technical needs, plan delivery schedules, and ensure data integrity.
Establish and monitor
data quality, governance, and compliance
standards throughout project execution.
Mentor and guide team members on
Python best practices, AI frameworks, and data engineering design patterns .
Manage project timelines, status reporting, and delivery metrics using
Jira, ClickUp, and CI/CD pipelines .
Qualifications:
Bachelor's or master's degree in engineering, Computer Science, or related field.
Strong hands-on expertise in
Python, SQL, ETL, Advanced Excel, Power BI, and web scraping frameworks .
Exposure to
AI and automation frameworks
(LangChain, LlamaIndex, AutoGen) preferred.
Working knowledge of
AWS ,
GitHub ,
DevOps (Docker, Kubernetes) , and
workflow automation tools .
Proven experience managing
cross-functional data delivery teams
and handling
international client communication .
Excellent analytical, leadership, and problem-solving skills.
Project Management certifications ( PMP, Agile, or Scrum Master ) are an added advantage.