Snowflake Developer Python/Spark

Job description

<p><p><b>Description : </b> <br/><br/>We are seeking a highly skilled and experienced Snowflake Lead responsible for leading the design, development, and implementation of Snowflake-based data warehousing solutions.

You will leverage your deep understanding of ETL and Data Warehousing concepts to build robust and scalable data pipelines.

A key aspect of this role involves direct interaction with business users to gather and clarify requirements, ensuring that the delivered solutions meet their analytical needs.<br/><br/><b>Responsibilities : </b><br/><br/><b>Leadership & Delivery : </b> <br/><br/>- Lead a module or a team of developers in the design, development, and deployment of Snowflake solutions.<br/><br/>- Take ownership of the end-to-end delivery of Snowflake modules, ensuring adherence to timelines and quality standards.<br/><br/>- Provide technical guidance and mentorship to team members, fostering a collaborative and high-performing environment.<br/><br/>- Contribute to project planning, estimation, and risk management activities.<br/><br/><b>Snowflake Expertise : </b> <br/><br/>- Utilize in-depth knowledge of Snowflake architecture, features, and best practices to design efficient and scalable data models and ETL/ELT processes.<br/><br/>- Develop and optimize complex SQL queries and Snowflake scripting for data manipulation and transformation.<br/><br/>- Implement Snowflake utilities such as SnowSQL, Snowpipe, Tasks, Streams, Time Travel, and Cloning as needed.<br/><br/>- Ensure data security and implement appropriate access controls within the Snowflake environment.<br/><br/>- Monitor and optimize the performance of Snowflake queries and data pipelines.<br/><br/>- Integrate PySpark with Snowflake for data ingestion and processing.<br/><br/>- Understand and apply PySpark best practices and performance tuning techniques.<br/><br/>- Experience with Spark architecture and its components (e.g., Spark Core, Spark SQL, DataFrames).<br/><br/><b>ETL & Data Warehousing : </b> <br/><br/>- Apply strong understanding of ETL/ELT concepts, data warehousing principles (including dimensional modeling, star/snowflake schemas), and data integration techniques.<br/><br/>- Design and develop data pipelines to extract data from various source systems, transform it according to business rules, and load it into Snowflake.<br/><br/>- Work with both structured and semi-structured data, including JSON and XML.<br/><br/>- Experience with ETL tools (e.g., Informatica, Talend, pyspark) is a plus, particularly in the context of integrating with Snowflake.<br/><br/><b>Requirements Gathering & Clarification : </b> <br/><br/>- Actively participate in requirement gathering sessions with business users and stakeholders.<br/><br/>- Translate business requirements into clear and concise technical specifications and design documents.<br/><br/>- Collaborate with business analysts and users to clarify ambiguities and ensure a thorough understanding of data and reporting needs.<br/><br/>- Validate proposed solutions with users to ensure they meet expectations.<br/><br/><b>Collaboration & Communication : </b> <br/><br/>- Work closely with other development teams, data engineers, and business intelligence analysts to ensure seamless integration of Snowflake solutions with other systems.<br/><br/>- Communicate effectively with both technical and non-technical stakeholders.<br/><br/>- Provide regular updates on progress and any potential roadblocks.<br/><br/><b>Best Practices & Continuous Improvement : </b> <br/><br/>- Adhere to and promote best practices in Snowflake development, data warehousing, and ETL processes.<br/><br/>- Stay up-to-date with the latest Snowflake features and industry trends.<br/><br/>- Identify opportunities for process improvement and optimization.<br/><br/><b>Qualifications : </b><br/><br/>- Bachelor's degree in Computer Science, Information Technology, or a related field.<br/><br/>- Minimum of 5 years of relevant experience in data warehousing and ETL development, with a significant focus on Snowflake.<br/><br/>- Strong proficiency in SQL and experience working with large datasets.<br/><br/>- Solid understanding of data modeling concepts (dimensional modeling, star/snowflake schemas).<br/><br/>- Experience in designing and developing ETL or ELT pipelines.<br/><br/>- Proven ability to gather and document business and technical requirements.<br/><br/>- Excellent communication, interpersonal, and problem-solving skills.<br/><br/>- Snowflake certifications (e.g., SnowPro Core) are a plus.</p><br/></p> (ref:hirist.tech)

Required Skill Profession

Computer Occupations