<p><p><b>Job Title : </b> Data Engineer Workflow Automation & Analytics.<br/><br/><b>Experience : </b> 36 years.<br/><br/><b>Employment Type : </b> Overview : </b></p><p><br/></p><p>We are seeking a technically strong and highly analytical Data Engineer to join our onsite team.
This role demands hands-on expertise in workflow automation, data pipeline development, and dashboarding, as well as strong skills in database investigation and optimization.
Experience with AWS services such as EMR, ECS, and S3 is a Responsibilities : </b><br/><br/></p><p>- Design, build, and maintain scalable ETL/ELT workflows using Apache Airflow or Prefect.<br/><br/></p><p>- Write clean and efficient Python and PySpark scripts for large-scale data processing.<br/><br/></p><p>- Investigate and debug data anomalies through advanced SQL and database forensics.<br/><br/></p><p>- Develop interactive dashboards and reports using Power BI and Metabase.<br/><br/></p><p>- Collaborate with cross-functional teams to ensure data accuracy, consistency, and availability.<br/><br/></p><p>- Optimize workflows and data processing jobs on AWS infrastructure including EMR and ECS.<br/><br/></p><p>- Set up alerts, monitoring, and logging to maintain high reliability in data Skills : </b></p><p><br/></p>- Hands-on experience with Apache Airflow and/or Prefect for workflow orchestration.<br/><br/></p><p>- Proficiency in Python and PySpark for data transformation and processing.<br/><br/></p><p>- Solid knowledge of SQL and data investigation techniques in complex database systems.<br/><br/></p><p>- Experience building visualisations and reports with Power BI and Metabase.<br/><br/></p><p>- Familiarity with Git, CI/CD practices, and working in fast-paced, production to Have : </b></p><p><br/></p>- Experience with AWS services : EMR, ECS, S3, Lambda, etc.<br/><br/></p><p>- Understanding of data warehousing (e.g., Redshift, Snowflake, BigQuery).<br/><br/></p><p>- Familiarity with Docker, Kubernetes, or other orchestration tools.<br/><br/></p><p>- Exposure to CRM data environments (e.g., Salesforce, Zoho) is a Skills : </b></p><p><br/></p>- Strong analytical and problem-solving mindset.<br/><br/></p><p>- Excellent communication and documentation skills.<br/><br/></p><p>- Self-motivated, proactive, and able to work independently in an onsite team setting.</p><br/></p> (ref:hirist.tech)