Kafka Architect (Kafka Event Hub Stream)
Job Description:
The Kafka Architect will be a senior architect/engineer responsible for designing, implementing, and advising on large-scale Confluent Kafka platforms.
This role involves guiding the overall direction of the Kafka platform, ensuring alignment with business objectives and collaborating with various technology stakeholders.
Roles and Responsibilities:
* Lead the design and architecture of large-scale Confluent Kafka platforms.
* Develop and maintain architectural artifacts for Kafka solutions.
* Ensure Kafka platform meets requirements for performance, scalability, reliability, and security.
* Provide expert guidance on Kafka best practices, including topic design, partitioning, replication, and security.
* Collaborate with development teams, other architects, and operations.
* Partner with technology decision-makers to guide the overall direction of the platform.
* Identify and implement optimizations for Kafka clusters.
Years of Experience: 7-10+ years
Primary Skillset:** Confluent Kafka, Apache Kafka, Kafka Streams, KSQL, ZooKeeper, Event-driven architecture.
Secondary Skillset: ** Java/Scala development, Kubernetes/Cloud deployment for Kafka, Monitoring tools (e.g., Prometheus, Grafana).
Must-have Skills:
* Proven experience in designing and implementing large-scale Confluent Kafka platforms.
* Deep understanding of Kafka architecture, core concepts, and ecosystem components (Connect, Streams, Schema Registry).
* Experience with Kafka security (authentication, authorization, encryption).
* Hands-on experience with Kafka cluster administration, monitoring, and troubleshooting.
Good-to-have Skills:
* Confluent Certified Developer/Administrator for Apache Kafka.
* Experience with deploying Kafka on Kubernetes.
* Knowledge of other streaming technologies.