• Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role.
India Jobs Expertini

Senior Data Engineer - (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) Job Opening In Bengaluru – Now Hiring The Nielsen Company

Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda)

    India Jobs Expertini Expertini India Jobs Bengaluru Computer Occupations Senior Data Engineer (Spark, Presto, Pandas, Rds, Ec2, S3, Athena, Lambda)

Job description

At Nielsen, we believe that career growth is a partnership.

You ultimately own, fuel and set the journey.

By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed.

We champion you because when you succeed, we do too.

Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve.

We enable your best to power our future.

As a Software Data Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases.

Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.

Responsibilities

  • Work closely with team leads and backend developers to design and develop functional, robust data pipelines to support internal and customer needs
  • Write unit, integration, and DQA tests, and develop automation tools for daily tasks
  • Develop high quality, well documented and efficient code 
  • Manage and optimize scalable pipelines in the cloud
  • Optimize internal and external applications for performance and scalability
  • Communicate regularly with project managers, quality engineers, and other developers regarding progress on long-term technology roadmap
  • Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives
  • Key Skills

  • Domain Expertise
  • 4-8 years of experience as a software/data engineer 
  • Bachelor’s degree in Computer Science, MIS, or Engineering
  • Technical Skills
  • Advanced experience with relational database systems (RDBMS), with advanced proficiency in SQL for data querying, manipulation.

    Additionally complex data analysis, optimization, and performance tuning (MySQL, PostgresSQL, Amazon RDS).

  • Advanced proficiency with data integration and ETL (Extract, Transform, Load) processes to move and transform data between systems.
  • Experience (2+ years) with data pipeline orchestration tools like Apache Airflow for workflow management and automation.
  • In-depth knowledge of data warehouse design principles and best practices, including schema design, indexing strategies, and partitioning techniques.
  • Experience with analytical data stores and strong understanding of distributed computing principles (, Spark, Presto, Pandas)
  • Advanced proficiency with cloud service technologies, ex: AWS (RDS, EC2, S3, Athena, Lambda)
  • Expertise in designing and optimizing data architectures for scalability, performance, and cost efficiency in cloud environments.
  • Experience with Docker container technology, familiar with kubernetes.
  • Experience with GIT (Gitlab preferred) source control systems
  • Familiarity with data governance, security, and compliance standards in cloud environments.
  • Experience with data visualization tools such as Tableau, Power BI, or Looker for creating interactive dashboards and reports
  • Mindset and attributes
  • Leadership and Mentoring skills to assist junior members of the data engineering team.
  • Proven track record of successfully completing end-to-end data projects from conception to implementation, including requirements gathering, design, development, testing, and deployment.
  • Strong problem-solving abilities to identify and resolve complex technical challenges in data processing and analytics.
  • Excellent project management skills to prioritize tasks, manage timelines, and deliver results within scope and budget constraints.
  • Effective communication skills to collaborate with stakeholders across different departments and levels of the organization.
  • Strategic thinking and ability to align data engineering initiatives with business objectives and organizational goals.
  • Continuous learning mindset to stay updated with emerging technologies, industry trends, and best practices in data engineering and analytics.
  • Required Skill Profession

    Computer Occupations


    • Job Details

    Related Jobs

    MPowerment Resources LLP hiring AWS Lead - Lambda/EC2 Job in Pune, Maharashtra, India
    MPowerment Resources LLP
    Pune, Maharashtra, India
    MPowerment Resources LLP hiring AWS Lead - Lambda/EC2 Job in Coimbatore, Tamil Nadu, India
    MPowerment Resources LLP
    Coimbatore, Tamil Nadu, India
    NUVENTO SYSTEMS PRIVATE LIMITED hiring Data Engineer - Python/Pandas Job in Bengaluru, Karnataka, India
    NUVENTO SYSTEMS PRIVATE LIMITED
    Bengaluru, Karnataka, India
    NUVENTO SYSTEMS PRIVATE LIMITED hiring Data Engineer - Python/Pandas Job in Chennai, Tamil Nadu, India
    NUVENTO SYSTEMS PRIVATE LIMITED
    Chennai, Tamil Nadu, India
    Tata Consultancy Services hiring Migration Engineer(Aws Services: Ec2, Vpc, Elb, S3, Iam, Cloudwatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in New Delhi, Delhi, India
    Tata Consultancy Services
    New Delhi, Delhi, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration engineer(aws services: ec2, vpc, elb, s3, iam, cloudwatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Bengaluru, India
    Tata Consultancy Services
    Bengaluru, Bengaluru, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Bengaluru, India
    Tata Consultancy Services
    Bengaluru, Bengaluru, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration engineer(aws services: ec2, vpc, elb, s3, iam, cloudwatch Job in Bengaluru, Karnataka, India
    Tata Consultancy Services
    Bengaluru, Karnataka, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in bangalore, bangalore, India
    Tata Consultancy Services
    bangalore, bangalore, India
    Tata Consultancy Services hiring Migration Engineer(AWS services: EC2, VPC, ELB, S3, IAM, CloudWatch Job in New Delhi, New Delhi, India
    Tata Consultancy Services
    New Delhi, New Delhi, India
    People Prime World Wide hiring Cloud Data Engineer - Amazon Athena Job in Hyderabad, Telangana, India
    People Prime World Wide
    Hyderabad, Telangana, India
    People Prime World Wide hiring Cloud Data Engineer - Amazon Athena Job in Bengaluru, Karnataka, India
    People Prime World Wide
    Bengaluru, Karnataka, India
    People Prime World Wide hiring Cloud Data Engineer - Amazon Athena Job in Pune, Maharashtra, India
    People Prime World Wide
    Pune, Maharashtra, India
    People Prime World Wide hiring Cloud Data Engineer - Amazon Athena Job in Chennai, Tamil Nadu, India
    People Prime World Wide
    Chennai, Tamil Nadu, India
    People Prime World Wide hiring Cloud Data Engineer - Amazon Athena Job in India
    People Prime World Wide
    India
    Lumiq hiring Senior Data Engineer (Python, Pandas & Numpy) Job in Noida, Uttar Pradesh, India
    Lumiq
    Noida, Uttar Pradesh, India
    HCLTech hiring Spark Data Engineer Job in India
    HCLTech
    India
    Tata Consultancy Services hiring Spark Data Engineer Job in India
    Tata Consultancy Services
    India

    Unlock Your Senior Data Potential: Insight & Career Growth Guide


    Real-time Senior Data Jobs Trends (Graphical Representation)

    Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph here. Uncover the dynamic job market trends for Senior Data in Bengaluru, India, highlighting market share and opportunities for professionals in Senior Data roles.

    527264 Jobs in India
    527264
    42363 Jobs in Bengaluru
    42363
    Download Senior Data Jobs Trends in Bengaluru and India

    Are You Looking for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) Job?

    Great news! is currently hiring and seeking a Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) to join their team. Feel free to download the job details.

    Wait no longer! Are you also interested in exploring similar jobs? Search now: .

    The Work Culture

    An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at The Nielsen Company adheres to the cultural norms as outlined by Expertini.

    The fundamental ethical values are:

    1. Independence

    2. Loyalty

    3. Impartiapty

    4. Integrity

    5. Accountabipty

    6. Respect for human rights

    7. Obeying India laws and regulations

    What Is the Average Salary Range for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) Positions?

    The average salary range for a varies, but the pay scale is rated "Standard" in Bengaluru. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.

    What Are the Key Qualifications for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda)?

    Key qualifications for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) typically include Computer Occupations and a list of qualifications and expertise as mentioned in the job specification. The generic skills are mostly outlined by the . Be sure to check the specific job listing for detailed requirements and qualifications.

    How Can I Improve My Chances of Getting Hired for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda)?

    To improve your chances of getting hired for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda), consider enhancing your skills. Check your CV/Résumé Score with our free Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.

    Interview Tips for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) Job Success

    The Nielsen Company interview tips for Senior Data Engineer   (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda)

    Here are some tips to help you prepare for and ace your Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) job interview:

    Before the Interview:

    Research: Learn about the The Nielsen Company's mission, values, products, and the specific job requirements and get further information about

    Other Openings

    Practice: Prepare answers to common interview questions and rehearse using the STAR method (Situation, Task, Action, Result) to showcase your skills and experiences.

    Dress Professionally: Choose attire appropriate for the company culture.

    Prepare Questions: Show your interest by having thoughtful questions for the interviewer.

    Plan Your Commute: Allow ample time to arrive on time and avoid feeling rushed.

    During the Interview:

    Be Punctual: Arrive on time to demonstrate professionalism and respect.

    Make a Great First Impression: Greet the interviewer with a handshake, smile, and eye contact.

    Confidence and Enthusiasm: Project a positive attitude and show your genuine interest in the opportunity.

    Answer Thoughtfully: Listen carefully, take a moment to formulate clear and concise responses. Highlight relevant skills and experiences using the STAR method.

    Ask Prepared Questions: Demonstrate curiosity and engagement with the role and company.

    Follow Up: Send a thank-you email to the interviewer within 24 hours.

    Additional Tips:

    Be Yourself: Let your personality shine through while maintaining professionalism.

    Be Honest: Don't exaggerate your skills or experience.

    Be Positive: Focus on your strengths and accomplishments.

    Body Language: Maintain good posture, avoid fidgeting, and make eye contact.

    Turn Off Phone: Avoid distractions during the interview.

    Final Thought:

    To prepare for your Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) interview at The Nielsen Company, research the company, understand the job requirements, and practice common interview questions.

    Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the The Nielsen Company's products or services and be prepared to discuss how you can contribute to their success.

    By following these tips, you can increase your chances of making a positive impression and landing the job!

    How to Set Up Job Alerts for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) Positions

    Setting up job alerts for Senior Data Engineer (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda) is easy with India Jobs Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!