Job Title: Senior Data Engineer
Skills: Data Engineering, AgenticAI, Python, SQL, Api’s, Azure cloud services, SQL and NoSQL ,Docker, Kubernetes.
Location: Pan India
Job Type: Full-Time
Experience Level: 4-11 Years
About the Role:
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team.
The ideal candidate will have a strong background in Python, Azure, CI/CD, deployment, and writing efficient data pipelines.
You will be responsible for designing, developing, and maintaining robust data infrastructure and pipelines that support our data-driven decision-making processes.
Key Responsibilities:
· Data Pipeline Development: Design, develop, and maintain efficient and scalable data pipelines using Python and Azure tech stack.
· Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
· Documentation: Create and maintain comprehensive documentation for data pipelines, processes, and solutions.
· Troubleshooting: Identify and resolve data-related issues and bottlenecks.
Qualifications:
· Education: Bachelor's or Master's degree in Computer Science, Information Technology, or equivalent in related field.
· Experience: 6-8 years of experience in data engineering, with a strong focus on Python, Azure, CI/CD, and deployment.
· Technical Skills:
· Proficiency in Python, Api’s for data processing and automation.
· Extensive experience with Azure cloud services (Azure Data Factory, Azure Databricks, Azure SQL Database, etc.).
· Understanding of CI/CD principles and tools (e.G., Jenkins, GitLab CI/CD).
· Understandin with containerization and orchestration tools (e.G., Docker, Kubernetes).
· Knowledge of SQL and NoSQL databases.
· Familiarity with data warehousing concepts and technologies.
· Soft Skills:
· Excellent problem-solving and analytical skills.
· Strong communication and collaboration abilities.
· Ability to work independently and as part of a team.
· Detail-oriented with a focus on quality and accuracy.
Preferred Qualifications:
· Experience with big data technologies (e.G., Hadoop, Spark).
· Knowledge of machine learning and data science concepts.
· Certification in Azure or other relevant technologies.
Benefits:
· Competitive salary and performance-based bonuses.
· Health, dental, and vision insurance.
· Retirement savings plan with company match.
· Professional development opportunities.
· Flexible working hours and remote work options.