<p><p>We are looking for a skilled Kafka Engineer with 57 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka.
The Kafka Engineer will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration.
Youll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.</p><br/><p><b>Key Responsibilities : </b></p><p><br/></p><p>- Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.</p><p><br/></p><p>- Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro/Protobuf).<br/><br/></p><p>- Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.<br/><br/></p><p>- Collaborate with DevOps teams to automate CI/CD pipelines, deployment, and infrastructure provisioning for Kafka components.<br/><br/></p><p>- Implement security best practices including encryption, authentication, and access control for Kafka clusters.<br/><br/></p><p>- Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery </p><p>guarantees.<br/><br/></p><p>- Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.<br/><br/></p><p>- Participate in code reviews, knowledge-sharing sessions, and architectural discussions.</p><br/><p><b>Must-Have Skills : </b></p><p><br/></p><p>- 5 - 7 years of experience in backend or data engineering, with strong focus on Apache Kafka.<br/><br/></p><p>- Proficiency in Java for building Kafka producers/consumers and integration with backend services.<br/><br/></p><p>- Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).<br/><br/></p><p>- Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.<br/><br/></p><p>- Experience with CI/CD pipelines for Kafka component deployment and integration.<br/><br/></p><p>- Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and </p><p>automation.<br/><br/></p><p>- Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.</p><br/><p><b>Good-to-Have Skills : </b></p><p><br/></p><p>- Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.<br/><br/></p><p>- Familiarity with Kafka Connect and connectors for data ingestion and export.<br/><br/></p><p>- Exposure to Confluent Kafka Platform and Kafka REST Proxy.<br/><br/></p><p>- Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).<br/><br/></p><p>- Understanding of container orchestration platforms like Kubernetes or OpenShift.</p><p><br/></p><p>- Knowledge of cloud-native Kafka deployments (AWS MSK).<br/><br/></p><p>- Familiarity with Spring Boot for integrating Kafka in microservice environments.</p><br/></p> (ref:hirist.tech)