GCP data Engineer

Job description

WPP is a world leader in marketing services, with deep AI, data and technology capabilities, global presence and unrivalled creative talent.

Our clients include many of the biggest companies and advertisers in the world, including approximately 300 of the Fortune Global 500.

Our people are the key to our success.

We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow.

Why we're hiring:

At WPP, technology is at the heart of everything we do, and it is WPP IT's mission to enable everyone to collaborate, create and thrive.

WPP IT is undergoing a significant transformation to modernise ways of working, shift to cloud and micro-service-based architectures, drive automation, digitise colleague and client experiences and deliver insight from WPP's petabytes of data.

GroupM is the world's leading media investment company responsible for more than $63B in annual media investment through agencies Mindshare, MediaCom, Wavemaker, Essence and m/SIX, as well as the outcomes-driven programmatic audience company, Xaxis and data and technology company Choreograph.

GroupM's portfolio includes Data & Technology, Investment and Services, all united in a vision to shape the next era of media where advertising works better for people.

By leveraging all the benefits of scale, the company innovates, differentiates and generates sustained value for our clients wherever they do business.

The GroupM IT team in WPP IT are the technology solutions partner for the GroupM group of agencies and are accountable for co-ordinating and assuring end-to-end change delivery, managing the GroupM IT technology life-cycle and innovation pipeline.

This role will work as part of the Local Systems Team for EMEA.

You will be part of a new team Data team in Chennai, that will support our existing and future BI setup for EMEA markets.

You will be responsible for delivering the solutions formulated by product owners and key stakeholders for different EMEA markets.

In collaboration with the Data development team, you update the architecture and data models to new data needs and changes in source systems.

What you'll be doing:

• Assist in the build, development, and management of custom databases/solutions using SSIS.
• Monitoring and optimizing data processing and storage resources on GCP.
• Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project
• Design, build and deploy ETL and data management processes.
  
  Develop and deploy ETL job workflow with reliable error/exception handling and rollback framework.
• Monitoring and optimizing data processing and storage resources on GCP.
• Troubleshooting and resolving data pipeline issues and performance bottlenecks.
• Documenting data engineering processes, best practices, and technical specifications.
• Conform to agile development practices – Evolutionary design, refactoring, continuous integration/delivery, test-driven development.
• Work collaboratively with Business Partner Team and Business Stakeholder during projects scoping and feasibility phases as a SME for concept investigation/viability and technical impact; Identify and communicate technical risks and mitigations.
• Provide production support for data load jobs.
• Write customized query to generate automatic periodic reports.
• Build applications writing SQL scripts to manipulate data and / or writing specific instructions for an off-shore programmer to write the scripts.
• Maintain or upgrade existing applications.
• Attend key design meetings and provide support.
• Other ad hoc duties.
• 
  

What you'll need:

• 2+ years experience with creating and managing SSIS and writing TSQL (views/functions/stored procedures).
• 3+ years experienced engineer who has worked on GCP environment and its relevant tools/services.
  
  (Big Query, Data Proc, Data flow, Workflows, Cloud Storage, Terraform, Cloudrun , Cloud scheduler, Astronomer/Airflow)
• 1 or 2 + years of strong experience in Python development (Object oriented/Functional Programming, Pandas, Pyspark etc)
• 1 or 2 + years of strong experience in SQL Language (CTEs, Window functions, Aggregate functions etc)
• Good to have DBT knowledge
• Experience with major RDBMS systems like MS-SQL, Oracle, PostgreSQL, Teradata etc
• Hands-on with GitHub or equivalent source control repositories
• Bachelor's degree in Computer Science, Engineering, Mathematics or other technical field is highly preferred.
• Experience with data modeling, and working with star schema
• Experience with the full development life cycle of an application stack - from architecture through test and deployment.
• Demonstrated experience in data warehouse analysis and design, with full knowledge of data warehouse methodologies and data modelling.
• Unit testing low level components – SQL scripts, Stored Procedures, ETL modules; Integration testing data transition points; Performance, load and stress testing.
• Knowledge and experience in software development methodology and toolset for implementing, lifecycle and management – Agile methodology.
• TFS/GIT code repository and branching strategies; Microsoft Release Management and any deployment tools; Jira knowledge.
• Team player
• Organized and detail oriented
• Excellent communication, presentation, and writing skills

Required Skill Profession

Computer Occupations