AppSierra Solutions Senior Data Engineer ETL Infrastructure

Job description

<p><p><b>Description :</b><br/><br/></p><p><br/>We are seeking a Senior Data Engineer with strong team leadership skills to join our growing team of analytics experts for remote work.<br/><br/></p><p><br/>In this role, you will be responsible for designing, expanding, and optimizing our data infrastructure and pipeline architecture, while also mentoring and leading a team of data engineers.

</p><p><br/></p><p>You will play a key role in ensuring efficient data flow and collection across cross-functional teams, helping to establish best practices and drive technical excellence.<br/><br/></p><p><br/>The ideal candidate is a hands-on builder and leader experienced in developing scalable data systems, building robust data pipelines, managing complex datasets, and fostering a high-performing team environment.

You should be passionate about leveraging data to drive insights, innovation, and business outcomes.<br/><br/><b>Key Responsibilities :</b><br/><br/></p><p><br/>- Design, build, and maintain robust and scalable data pipeline architectures.<br/><br/></p><p><br/>- Assemble large, complex datasets that meet both functional and non-functional business requirements.<br/><br/></p><p><br/>- Identify, design, and implement internal process improvements including automation of manual workflows, optimization of data delivery, and re-architecting infrastructure for greater scalability and reliability.<br/><br/></p><p><br/>- Design, build, and optimize ETL infrastructure to enable scalable, high-quality data workflows across diverse sources, leveraging SQL and modern data processing frameworks.<br/><br/></p><p><br/>- Build analytics tools that utilize the data pipeline to deliver actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.<br/><br/></p><p><br/>- Collaborate with stakeholders across Executive, Product, Data, and Design teams to resolve data-related technical issues and ensure their data infrastructure needs are met.<br/><br/></p><p><br/>- Ensure data integrity, separation, and security across multiple data centers and AWS regions.<br/><br/></p><p><br/>- Create data tools and frameworks to empower analytics and data science teams in building and optimizing products that drive innovation and establish market leadership.<br/><br/></p><p><br/>- Lead and mentor a small team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement.<br/><br/></p><p><br/>- Provide technical guidance, set coding standards, conduct code reviews, and support career development for team members.<br/><br/></p><p><br/>- Work closely with data and analytics experts to continually enhance the functionality, reliability, and scalability of our data systems.<br/><br/><b>Qualifications :</b><br/><br/><b>Data Engineering and Infrastructure :</b><br/><br/></p><p><br/>- 6+ years of experience in a Data Engineering role, designing, building, and managing scalable and reliable data systems.<br/><br/></p><p><br/>- Proficient with big data and stream-processing technologies such as Spark and Kafka.<br/><br/></p><p><br/>- Hands-on experience with cloud platforms, particularly AWS services like EC2 and RDS.<br/><br/></p><p><br/>- Skilled in building and orchestrating data pipelines using tools like Airflow.<br/><br/></p><p><br/>- Experience with Databricks for scalable data processing and advanced analytics.<br/><br/></p><p><br/>- Strong knowledge of SQLMesh for modern data workflow management.<br/><br/></p><p><br/>- Extensive experience integrating and working with external data sources via REST APIs, GraphQL endpoints, and SFTP servers.<br/><br/></p><p><br/>- Strong communication skills and leadership capabilities are required.<br/><br/><b>Databases and Data Management :</b><br/><br/></p><p><br/>- Expertise with relational and NoSQL databases, including Postgres and MongoDB.<br/><br/></p><p><br/>- Solid understanding of data modeling, data governance, and data security best practices.<br/><br/><b>Programming and Development :</b><br/><br/></p><p><br/>- Proficient in Python for data engineering, automation, and workflow scripting.<br/><br/></p><p><br/>- Familiarity with software engineering best practices, including version control, testing, and CI/CD pipelines for data workflows.<br/><br/></p><p><br/>- Experience with JavaScript and TypeScript is a plus.<br/><br/><b>Analytics, Visualization, and BI :</b><br/><br/></p><p><br/>- Skilled in implementing and supporting self-service BI tools to enable business teams with accessible, actionable insights.<br/><br/></p><p><br/>- Experience with Streamlit for building interactive data visualizations is a plus.<br/><br/><b>Blockchain and Financial Data Expertise :</b><br/><br/></p><p><br/>- Knowledge of blockchain technology and the cryptocurrency ecosystem is a nice-to-have, with a strong interest in staying up to date with emerging trends.<br/><br/></p><p><br/>- Experience working with financial datasets and financial engineering concepts is considered a strong advantage.<br/><br/><b>Our Stack :</b><br/><br/></p><p><br/>We work with a modern and evolving technology stack, including but not limited to :<br/><br/></p><p><br/>- Cloud Infrastructure : AWS for cloud services and infrastructure management<br/><br/></p><p><br/>- Databases : PostgreSQL for relational data, MongoDB for non-relational (NoSQL) data, and Redis for caching and real-time data management<br/><br/></p><p><br/>- Backend : NestJS (Node.js, TypeScript) and Python for building scalable backend services<br/><br/></p><p><br/>- Frontend : React for web applications, Streamlit for building interactive data visualizations<br/><br/></p><p><br/>- Data Engineering : Airflow and SQLMesh for data pipeline orchestration and modern workflow management<br/><br/></p><p><br/>- Big Data & Processing : Databricks and Kafka for scalable data processing, analytics, and streaming<br/><br/></p><p><br/>- Integrations & APIs : Extensive use of REST APIs, GraphQL, SFTP, and Slack integrations to enable seamless data exchange and operational workflows</p><p><br/></p><p><br/>- Messaging & Event Streaming : Kafka for real-time data pipelines and event-driven architectures</p><br/></p> (ref:hirist.tech)

Required Skill Profession

Computer Occupations