Job description
Job Title: Senior Python Pyspark Data Engineer
Experience: 8+ Years
Employment Type: Full-Time, Permanent
Location- Pune/ Bangalore/ Indore
About the Role :-
We are looking for a Senior Python PySpark Data Engineer to design, develop, and maintain
scalable data pipelines and applications in a fast-paced, cloud-first environment.
You will
build end-to-end data solutions using Python, PySpark, and Azure cloud services,
contributing to architecture, performance optimization, and code quality.
This role offers an opportunity to work on modern data platforms including Databricks and
Azure Data Factory (ADF), collaborating with cross-functional teams to deliver
high-performance, production-grade data solutions.
Key Responsibilities :-
● Design, develop, and maintain robust, scalable data pipelines using Python and
PySpark.
● Build end-to-end data solutions from scratch with modular, maintainable, and
reusable code.
● Write and optimize complex SQL queries for large-scale data processing and
validation.
● Develop dynamic, reusable frameworks and implement design patterns for scalability
and performance.
● Refactor legacy codebases to improve performance, reliability, and maintainability.
● Collaborate with data engineers, analysts, and business stakeholders to translate
requirements into technical solutions.
● Orchestrate workflows and automate pipelines using Databricks and Azure Data
Factory (ADF).
● Drive best practices in code reviews, deployment automation, and performance
tuning.
● Stay current with emerging tools and contribute to continuous improvement
initiatives.
Must-Have Skills & Qualifications :-
● Hands-on experience in software/data engineering.
● Strong expertise in Core Python and PySpark development.
● Proficient in SQL, with experience handling large datasets.
● Hands-on experience with Azure Cloud Data Services.
● Experience with Databricks and Azure Data Factory (ADF).
● Solid understanding of data structures, design patterns, and scalable architectures.
● Expertise in performance optimization, debugging, and automation.
● Exposure to other cloud platforms (AWS/GCP) is a plus.
● Bachelor’s degree in Computer Science, Engineering, or related field.
● Strong problem-solving mindset with ability to deliver end-to-end solutions.
Why You’ll Love This Role :-
● Freedom to build scalable data systems from the ground up.
● Work with modern cloud technologies: Azure, Databricks, ADF.
● Collaborate with a team that values innovation, clean engineering, and
problem-solving.
● Influence architecture and design decisions for enterprise-level solutions.
● Fast-paced, learning-driven environment where your ideas are implemented.
If Intrested.
Please submit your CV to aman_sariyam@sourcebae.com
Stay updated with our latest job opportunities and company news by following us on LinkedIn: :https://www.linkedin.com/company/sourcebae
Required Skill Profession
Computer Occupations