Job Description
<p><p>We are looking for a highly skilled and experienced Senior Data Engineer to join our team on a contract basis.
The ideal candidate will be a technical leader in developing, optimizing, and maintaining our core data infrastructure.
You'll be instrumental in shaping our data environment, ensuring data quality, and enabling critical business insights through robust data pipelines and warehousing solutions.<br/><br/><b>Responsibilities & Day-to-Day Tasks :</b><br/><br/>The Senior Data Engineer will be responsible for the full lifecycle of data infrastructure, including:<br/><br/>- Design and Development: Architecting, designing, and implementing scalable and efficient Extract, Transform, Load (ETL) and ELT processes to integrate data from diverse sources.<br/><br/>- Data Modeling: Developing and maintaining dimensional and relational data models for optimal storage, retrieval, and analytics within the Data Warehouse environment.<br/><br/>- Data Pipeline Construction: Building, testing, and maintaining high-performance data pipelines using Python for complex data manipulations, transformations, and automation.<br/><br/>- Database Management: Writing, optimizing, and tuning complex SQL queries, stored procedures, and scripts to manage and retrieve large datasets efficiently.<br/><br/>- Optimization: Continuously monitoring, troubleshooting, and optimizing data infrastructure and ETL jobs for improved performance, reliability, and cost-efficiency.<br/><br/>- Data Quality & Integrity: Implementing rigorous processes and checks to ensure the quality, accuracy, and integrity of data across all systems.<br/><br/>- Data Analytics Support: Collaborating closely with data scientists, analysts, and business stakeholders to understand their data requirements and provide structured datasets for Data Analytics and reporting.<br/><br/>- Cross-Functional Collaboration: Working with cross-functional teams (product, engineering, operations) to understand business needs and translate them into technical data solutions.<br/><br/><b>Required Qualifications & Experience :</b><br/><br/>- Experience: 8+ years of hands-on experience in Data Engineering or a similar role.<br/><br/>- Core Skills: Demonstrated expertise in Data Modeling (e.g., Star Schema, Snowflake Schema, 3NF) and deep understanding of data warehousing concepts.<br/><br/>- Programming Proficiency: Expert-level proficiency in Python for data manipulation, scripting, and building complex data pipelines.<br/><br/>- Database Expertise: Strong proficiency in SQL (including advanced querying, query optimization, and stored procedures) across various database systems.<br/><br/>- ETL/Data Warehousing: Extensive, proven experience designing, developing, and operating robust, high-volume ETL/ELT processes and managing enterprise-level Data Warehouses.<br/><br/>- Problem-Solving: Excellent analytical and problem-solving skills with a strong attention to detail.<br/><br/>- Education: Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.<br/><br/>- Work Style: Proven ability to thrive both independently and as a key member of a collaborative team.<br/><br/><b>Preferred Qualifications (Nice to Have) :</b><br/><br/>- Cloud Platforms: Experience with cloud-based data platforms and services (e.g., AWS services like S3, Redshift, Glue; Azure services like Data Factory, Synapse; or GCP services like BigQuery, Dataflow).<br/><br/>- Big Data Ecosystem: Familiarity with Big Data technologies (e.g., Spark, Hadoop) or experience working with NoSQL databases.<br/><br/>- Data Ops/Automation: Experience with CI/CD, version control (Git), and automation tools related to data pipelines and infrastructure.</p><br/></p> (ref:hirist.tech)