Associate Data Architect I Adf, Adb

Job description

9 - 12 Years 1 Opening Trivandrum Role description Role Proficiency: Leverage expertise in a technology area (e.G. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects.

Outcomes: Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows.

Develop design for data acquisitions and data transformation or data modelling;
applying business intelligence on data or design data fetching and dashboards Design information structure work-and dataflow navigation.

Define backup recovery and security specifications Enforce and maintain naming standards and data dictionary for data models Provide or guide team to perform estimates Help team to develop proof of concepts (POC) and solution relevant to customer problems.

Able to trouble shoot problems while developing POCs Architect/Big Data Speciality Certification in (AWS/AZURE/GCP/General for example Coursera or similar learning platform/Any ML) Measures of Outcomes: Percentage of billable time spent in a year for developing and implementing data transformation or data storage Number of best practices documented in any new tool and technology emerging in the market Number of associates trained on the data service practice Outputs Expected: Strategy & Planning: Create or contribute short-term tactical solutions to achieve long-term objectives and an overall data management roadmap Implement methods and procedures for tracking data quality completeness redundancy and improvement Ensure that data strategies and architectures meet regulatory compliance requirements Begin engaging external stakeholders including standards organizations regulatory bodies operators and scientific research communities or attend conferences with respect to data in cloud Operational Management : Help Architects to establish governance stewardship and frameworks for managing data across the organization Provide support in implementing the appropriate tools software applications and systems to support data technology goals Collaborate with project managers and business teams for all projects involving enterprise data Analyse data-related issues with systems integration compatibility and multi-platform integration Project Control and Review : Provide advice to teams facing complex technical issues in the course of project delivery Define and measure project and program specific architectural and technology quality metrics Knowledge Management & Capability Development : Publish and maintain a repository of solutions best practices and standards and other knowledge articles for data management Conduct and facilitate knowledge sharing and learning sessions across the team Gain industry standard certifications on technology or area of expertise Support technical skill building (including hiring and training) for the team based on inputs from project manager /RTE's Mentor new members in the team in technical areas Gain and cultivate domain expertise to provide best and optimized solution to customer (delivery) Requirement gathering and Analysis: Work with customer business owners and other teams to collect analyze and understand the requirements including NFRs/define NFRs Analyze gaps/ trade-offs based on current system context and industry practices;
clarify the requirements by working with the customer Define the systems and sub-systems that define the programs People Management: Set goals and manage performance of team engineers Provide career guidance to technical specialists and mentor them Alliance Management: Identify alliance partners based on the understanding of service offerings and client requirements In collaboration with Architect create a compelling business case around the offerings Conduct beta testing of the offerings and relevance to program Technology Consulting: In collaboration with Architects II and III analyze the application and technology landscapers process and tolls to arrive at the architecture options best fit for the client program Analyze Cost Vs Benefits of solution options Support Architects II and III to create a technology/ architecture roadmap for the client Define Architecture strategy for the program Innovation and Thought Leadership: Participate in internal and external forums (seminars paper presentation etc) Understand clients existing business at the program level and explore new avenues to save cost and bring process efficiency Identify business opportunities to create reusable components/accelerators and reuse existing components and best practices Project Management Support: Assist the PM/Scrum Master/Program Manager to identify technical risks and come-up with mitigation strategies Stakeholder Management: Monitor the concerns of internal stakeholders like Product Managers & RTE's and external stakeholders like client architects on Architecture aspects.

Follow through on commitments to achieve timely resolution of issues Conduct initiatives to meet client expectations Work to expand professional network in the client organization at team and program levels New Service Design: Identify potential opportunities for new service offerings based on customer voice/ partner inputs Conduct beta testing / POC as applicable Develop collaterals guides for GTM Skill Examples: Use data services knowledge creating POC to meet a business requirements;
contextualize the solution to the industry under guidance of Architects Use technology knowledge to create Proof of Concept (POC) / (reusable) assets under the guidance of the specialist.

Apply best practices in own area of work helping with performance troubleshooting and other complex troubleshooting.

Define decide and defend the technology choices made review solution under guidance Use knowledge of technology t rends to provide inputs on potential areas of opportunity for UST Use independent knowledge of Design Patterns Tools and Principles to create high level design for the given requirements.

Evaluate multiple design options and choose the appropriate options for best possible trade-offs.

Conduct knowledge sessions to enhance team's design capabilities.

Review the low and high level design created by Specialists for efficiency (consumption of hardware memory and memory leaks etc.) Use knowledge of Software Development Process Tools & Techniques to identify and assess incremental improvements for software development process methodology and tools.

Take technical responsibility for all stages in the software development process.

Conduct optimal coding with clear understanding of memory leakage and related impact.

Implement global standards and guidelines relevant to programming and development come up with 'points of view' and new technological ideas Use knowledge of Project Management & Agile Tools and Techniques to support plan and manage medium size projects/programs as defined within UST;
identifying risks and mitigation strategies Use knowledge of Project Metrics to understand relevance in project.

Collect and collate project metrics and share with the relevant stakeholders Use knowledge of Estimation and Resource Planning to create estimate and plan resources for specific modules or small projects with detailed requirements or user stories in place Strong proficiencies in understanding data workflows and dataflow Attention to details High analytical capabilities Knowledge Examples: Data visualization Data migration RDMSs (relational database management systems SQL Hadoop technologies like MapReduce Hive and Pig.

Programming languages especially Python and Java Operating systems like UNIX and MS Windows.

Backup/archival software.

Additional Comments: We are seeking a highly experienced Lead Data Engineer with over 12 years of expertise in building scalable data solutions and modern data platforms.

The ideal candidate will have a strong background in PySpark, SQL, Azure Databricks, and cloud platforms such as AWS or GCP.

You will be responsible for leading the design and implementation of robust ETL/ELT pipelines, data modeling using Kimball/star schema, and mentoring a team of engineers in a fast-paced data-driven environment.

Key Responsibilities: Design, develop, and maintain scalable and efficient ETL/ELT data pipelines to support data ingestion, processing, and analytics.

Lead architecture and design discussions for big data solutions leveraging PySpark, SQL, and cloud-native tools (Azure Databricks, AWS Glue, GCP Dataflow, etc.).

Implement and optimize data models using Kimball/star schema or similar dimensional modeling techniques.

Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and deliver solutions.

Ensure data quality, integrity, and governance across pipelines and data platforms.

Drive the adoption of engineering best practices, code reviews, CI/CD, and automation in data workflows.

Mentor and lead a team of data engineers, providing technical guidance and career development support.

Required Skills & Qualifications: 12+ years of hands-on experience in Data Engineering or related fields.

Strong expertise in PySpark and advanced SQL for data processing and transformation.

Proven experience with Azure Databricks and at least one major cloud platform (AWS or GCP).

Deep understanding of data warehousing concepts and dimensional data modeling (Kimball/star schema).

Expertise in designing and building data pipelines using ETL/ELT frameworks.

Familiarity with orchestration tools (e.G., Airflow, Azure Data Factory, Step Functions).

Strong problem-solving skills and ability to manage large-scale data systems.

Excellent communication and leadership skills, with experience leading engineering teams.

Skills Python,Pyspark,Azure Databricks,Azure Data Factory About UST UST is a global digital transformation solutions provider.

For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation.

Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation.

With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations.

With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

Required Skill Profession

Computer Occupations