Data Engineer

Job description

Role : Data Engineer
Location : Remote
Shift Timing : 2:00 Pm - 11:00 Pm
Experience : 2- 4 years relevant Experience only ( this is a Junior position with us )
Must have skillset :
GCP - 2 years minimum working Experience
Python and Pyspark - 2 years
SQL - 2 years
Excellent communication
Worked with global stakeholders
Who we are:
Randstad Sourceright’s global talent solutions provides instant access to experienced recruitment
and contingent workforce management support by combining technology, analytics and deep
global and local expertise.

Our operations consist of the client aligned service delivery teams
operating across RPO, MSP and Blended Workforce Solutions.

We are certified as a “great place to
work” for the last 3 consecutive years and are recognized as the best place to work by Glassdoor
Group Objective
The mission of the business intelligence team is to create a data-driven culture that empowers leaders to integrate data into daily decisions and strategic planning.

We aim to provide visibility, transparency, and guidance regarding the quantity and quality of results, activities, financial KPIs, and leading indicators to identify trends aimed at data-based decision-making easily.
Position Objective
As a Senior Data Engineer, you will be responsible for designing, architecting, and implementing robust data solutions in a cloud-based environment (GCP).

You will partner with other data engineers and technical teams to ensure the availability, reliability, and performance of our data systems.
Position Summary
Programming & Code Writing
Architect and build complex data pipelines using advanced cloud data technologies
Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
Define industry best practices for building data pipelines
Ensure data security, compliance, and governance standards are met.
Partner with leadership team to define and implement agile and DevOps methodologies
Consulting & Partnership
Serve as subject matter expert and define data architecture and infrastructure requirements
Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times
Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations
Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes
Troubleshooting & Continuous Improvement
Design and implement a robust data observability process
Resolve escalated reporting requests and communicate proactively and timely
Troubleshoot, and provide technical guidance to resolve issues related to misaligned or inaccurate data or data fields or new customer requirements
Maintain new release, migration, and sprint schedules for software upgrades, enhancements, and fixes to aid with product evolution
Write QA/QC Scripts to conduct first round of testing and partner with BA team for test validation for new developments prior to moving to production
Use industry knowledge & feedback to aid in the development of technology roadmap and future product(s) vision
Document standard ways of working via QRGs, intranet pages, and video series
Senior activities
Drive day-to-day development activities of development team in close collaboration with on-site and off-shore resources, scrum masters and product owners
Bootstrapping a data engineering team at an early stage in the team’s evolution
Provide leadership on technical front in difficult situations facilitate contentious discussions, and report up when necessary
Guide, mentor and coach offshore resources
Provide input in forming a long-term data strategy
Education
Master’s degree in Computer Science / Information Technology or related field, highly preferred
Experience
Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions
Extensive Experience with data lakes, ETL and data warehouses
Advanced experience of building data pipelines
Passion for building quality BI software
Project Management and/or process improvement experience highly preferred
Knowledge, Skills, and Abilities
Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. Tableau
Advanced and proven experience with Google cloud platform (GCP) is preferred.

But experience with Microsoft Azure / Amazon will be considered.
Any exposure to Kafka, Spark, and Scala will be an added advantage.
Should demonstrate a strong understanding of OOPS concepts and methodologies
Expert level understanding of data engineering
Intrinsic motivation and problem-solving
Proactive leadership, project management, time management, and problem-solving skills
Demonstrated continuous improvement, process documentation, and workflow skills
Extensive experience with data analysis , modeling, and data pipelining including data cleaning, standardizing, scaling, tuning, scheduling and deployment
Experience composing detailed technical documentation and procedures for data models
Ability to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining quality
Strong drive and commitment for delivering outstanding results
Strong follow up and service orientation
Supervisory Responsibility
☒ Provides guidance, leadership, or training to junior employees
☐ Directly responsible for supervising non-exempt, clerical, or office administrative personnel
☐ Directly responsible for supervising exempt, professional, or technical employees
☒ Directly responsible for supervising supervisory/managerial employees
Organizational Structure:
Job Title this position reports: Manager, Data Engineering

Required Skill Profession

Computer Occupations