Moolya - Data Engineer

<p>We are seeking an experienced Data Architect with strong expertise in designing, building, and maintaining scalable data pipelines and data processing solutions.

The ideal candidate will have hands-on experience with modern data engineering tools and frameworks, solid programming capabilities, and strong analytical thinking to support data-driven decision-making.<br/><br/>Key Responsibilities :<br/><br/>- Design, develop, and manage robust data pipelines and ETL workflows using PySpark, SQL, and Apache Airflow.<br/><br/>- Integrate data from multiple sources using connectors such as JDBC, Impala, and Hive.<br/><br/>- Optimize data ingestion and transformation processes for performance and scalability.<br/><br/>- Collaborate with data scientists, analysts, and business teams to understand requirements and deliver reliable datasets.<br/><br/>- Implement data quality checks, error handling, and pipeline monitoring to ensure high data integrity.<br/><br/>- Work with large-scale data systems in a distributed environment.<br/><br/>- Participate in code reviews and contribute to continuous improvement of data engineering practices.<br/><br/>Mandatory Skills :<br/><br/>- Strong hands-on experience in PySpark, SQL, and Apache Airflow.<br/><br/>- Experience in developing and managing data pipelines and ETL workflows.<br/><br/>- Proficiency with data connectors such as JDBC, Impala, and Hive.<br/><br/>- Good analytical and programming skills with attention to detail.<br/><br/>- Solid understanding of data structures, data modeling, and performance optimization.<br/><br/>Good to Have :<br/><br/>- Exposure to cloud platforms (Azure / AWS / GCP) and their data services.<br/><br/>- Experience with big data ecosystems (e.g., Hadoop, Databricks).<br/><br/>- Knowledge of version control (Git) and CI/CD for data pipelines.</p> (ref:hirist.tech)