Know ATS Score
CV/Résumé Score
  • Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role: Principal Data Pipeline Engineer.
India Jobs Expertini

Urgent! Principal Data Pipeline Engineer Job Opening In India, India – Now Hiring Coditas

Principal Data Pipeline Engineer



Job description

Roles and Responsibilities

● Understand Business requirements and implement scalable solutions.

● Translate complex technical and functional requirements into detailed designs

● Develop a highly scalable, reliable, and high-performance data processing pipeline to

extract, transform and load data from various systems to the Enterprise Data warehouse/Data Lake/Data Mesh

● Provide research, high-level design and estimates for data transformation and data integration from source applications to end-use

● Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.

● Develop comprehensive data products and implement them on cloud or in-house servers for production use.


Technical Skills

● Minimum 6-10 years of progressive experience building solutions in Big Data environments.

● Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant and reliable in terms of data movement.

● Hands-on experience of Apache Spark with Python for batch and stream processing.

● Should have knowledge of experience in batch and stream data processing

● Exposure working on projects across multiple domains.

● Strong hands on capabilities on SQL and NoSQL technologies.

● Minimum 3+ years of experience with AWS services like S3, DMS, Redshift, Glue, Lambda, Kinesis, MSK etc.

is must have or similar services of either Azure/GCP.

● Strong analytical/quantitative skills and comfortable working with huge sets of data.

● Excellent written and verbal communication skills.


Required Skill Profession

Computer Occupations



Your Complete Job Search Toolkit

✨ Smart • Intelligent • Private • Secure

Start Using Our Tools

Join thousands of professionals who've advanced their careers with our platform

Rate or Report This Job
If you feel this job is inaccurate or spam kindly report to us using below form.
Please Note: This is NOT a job application form.


    Unlock Your Principal Data Potential: Insight & Career Growth Guide