<p><p><b>Responsibilities : </b></p><p><br/></p><p>- Design, develop, and maintain scalable data platforms and pipelines.</p><p><br/></p><p>- Build data ingestion frameworks to collect data from diverse sources (structured and unstructured).<br/><br/></p><p>- Ensure high availability and performance of data systems.<br/><br/></p><p>- Automate data quality checks and monitoring.<br/><br/></p><p>- Collaborate with cross-functional teams to define data architecture and strategy.<br/><br/></p><p>- Implement data governance, security, and compliance practices.<br/><br/></p><p>- Optimize data workflows for performance, scalability, and : </b></p><p><br/></p><p>- Strong programming skills in Python, Java, or Scala.<br/><br/></p><p>- Hands-on experience with big data technologies such as Apache Spark, Kafka, Flink, and Hadoop.<br/><br/></p><p>- Experience with data orchestration tools like Airflow, Dagster, or Prefect.<br/><br/></p><p>- Solid understanding of cloud platforms (e.
g., AWS, GCP, or Azure) and cloud native data services (e.
g., S3 BigQuery, Redshift).<br/><br/></p><p>- Experience with CI/CD for data pipelines and infrastructure as code (e.
g., Terraform).<br/><br/></p><p>- Strong knowledge of SQL and relational as well as NoSQL databases.<br/><br/></p><p>- Understanding of data modeling, data warehousing, and ETL/ELT processes.<br/><br/></p><p>- Familiarity with containerization (Docker, Kubernetes) is a plus.<br/><br/></p><p>- Experience with monitoring and logging tools for data platforms (e.
g., Prometheus, Grafana, ELK stack).</p><p></p><br/></p> (ref:hirist.tech)