ETL Developer - Apache NiFi

<p>Job Description :</p><p><br/></p><p>Key Responsibilities :</p><p><br/></p><p>- Design, develop, and maintain robust ETL pipelines for large and complex datasets.</p><p><br/></p><p>- SQL and PL/pgSQL queries in PostgreSQL, ensuring efficiency in high-concurrency environments.</p><p><br/></p><p>- Manage and scale environments with 5000+ processor instances in PostgreSQL or equivalent setups.</p><p><br/></p><p>- Ingest, process, and validate data from multiple sources while ensuring data integrity, consistency, and availability.</p><p><br/></p><p>- Monitor ETL workflows, identify bottlenecks, and apply performance tuning techniques.</p><p><br/></p><p>- Collaborate with data architects, analysts, and business stakeholders to define and deliver data requirements.</p><p><br/></p><p>- Implement and maintain data quality, validation, and reconciliation across systems.</p><p><br/></p><p>- Document ETL processes, pipelines, and data architectures.</p><p><br/></p><p>- Ensure compliance with data security, governance, and privacy standards.</p><p><br/></p><p>Required Skills & Experience :</p><p><br/></p><p>- 5+ years of ETL development experience with complex data workflows.</p><p><br/></p><p>- Strong hands-on expertise in Apache NiFi (must-have).</p><p><br/></p><p>- Advanced experience with PostgreSQL (query optimization, scaling in massively parallel systems).</p><p><br/></p><p>- Proven ability to work in large-scale environments (e.g., 5000+ processor instances).</p><p><br/></p><p>- Proficiency in SQL, PL/pgSQL, and performance tuning techniques.</p><p><br/></p><p>- Hands-on experience with ETL tools like Talend, Informatica, Airflow, etc.</p><p><br/></p><p>- Familiarity with big data ecosystems (Hadoop, Spark, Kafka) is a plus.</p><p><br/></p><p>- Strong knowledge of data modeling, warehousing, and governance principles.</p><p><br/></p><p>- Excellent problem-solving, debugging, and analytical skills.</p><p><br/></p><p>Preferred Qualifications :</p><p><br/></p><p>- Experience with cloud platforms (AWS, GCP, Azure).</p><p><br/></p><p>- Exposure to DevOps and CI/CD practices for data pipelines.</p><p><br/></p><p>- Hands-on experience with real-time streaming data processing.</p><p><br/></p><p>- Knowledge of scripting languages (Python, Bash, etc.).</p><p><br/></p><p>Education : Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.</p> (ref:hirist.tech)