Know ATS Score
CV/Résumé Score
  • Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role: Kafka Administrator.
India Jobs Expertini

Urgent! Kafka Administrator Job Opening In India, India – Now Hiring Pylon Management Consulting



Job description

<p><p><b>Kafka Administration & Management :</b></p><p><p><b><br/></b></p>- Design, deploy, and maintain highly available Kafka clusters in on-premise or cloud environments<br/><br/></p><p>- Experience with and Understanding of cloud based messaging services like AWS MSK, Confluent Cloud, Azure Event Hubs, or GCP Pub/Sub).<br/><br/></p><p>- Configure and tune Kafka brokers, ZooKeeper, topics, partitions, and replication to ensure optimal performance and scalability.<br/><br/></p><p>- Implement Kafka security best practices, including SSL/TLS encryption, Kerberos authentication, ACLs, and role-based access control (RBAC).<br/><br/></p><p>- Monitor Kafka clusters using tools like Prometheus, Grafana, Confluent Control Center, and OpenTelemetry to track system health, resource utilization, and performance metrics.<br/><br/></p><p>- Troubleshoot Kafka broker failures, consumer/producer lag, replication issues, and other system bottlenecks.<br/><br/></p><p>- Manage Kafka Schema Registry, Kafka Connect, and Kafka Streams for seamless data integration across various platforms.<br/><br/></p><p>- Implement disaster recovery strategies, including cross-cluster replication with MirrorMaker & Batch Data Processing (Flink/Spark) :</b></p><p><b><br/></b></p>- Develop and optimize real-time streaming applications using Apache Flink for event-driven data processing.<br/><br/></p><p>- Implement complex event processing (CEP) and windowed aggregations in Flink for business analytics.<br/><br/></p><p>- Build and optimize Apache Spark jobs for batch data processing, ensuring high performance and cost efficiency.<br/><br/></p><p>- Integrate Flink/Spark applications with Kafka, Hadoop, S3, Snowflake, and NoSQL databases.<br/><br/></p><p>- Tune Flink and Spark performance parameters, including checkpointing, parallelism, and memory Infrastructure & Governance:</b></p><p><br/></p>- Deploy Kafka and Flink workloads in Kubernetes (K8s) using Helm charts and operators.<br/><br/></p><p>- Implement observability using distributed tracing, logging, and monitoring tools like Jaeger, ELK Stack, and Splunk.<br/><br/></p><p>- Collaborate with DevOps teams to automate Kafka infrastructure using Terraform, Ansible, or CloudFormation.<br/><br/></p><p>- Ensure data governance, lineage, and compliance (GDPR, HIPAA, SOC 2) by integrating Apache Atlas, Confluent RBAC, or Ranger.<br/><br/></p><p>- Work with data teams, ML engineers, and business stakeholders to build scalable and efficient data Qualifications :</b></p><p><br/></p>- 8+ years of experience in Kafka administration & data engineering with a strong focus on real-time streaming architectures.<br/><br/></p><p>- Expert-level knowledge of Apache Kafka internals, including broker configuration, producer/consumer tuning, and security.<br/><br/></p><p>- Strong hands-on experience in Kafka Streams, Kafka Connect, MirrorMaker 2.0, and Schema Registry.<br/><br/></p><p>- Proficiency in Apache Flink (or Spark Streaming) for stream processing.<br/><br/></p><p>- Strong programming skills in Python, Java, or Scala.<br/><br/></p><p>- Experience with SQL and NoSQL databases (e.g., PostgreSQL, Cassandra, MongoDB).<br/><br/></p><p>- Hands-on experience with cloud platforms (AWS, Azure, GCP) and Kubernetes.<br/><br/></p><p>- Knowledge of monitoring tools (Prometheus, Grafana, Confluent Control Center, Qualifications :</b></p><p><br/></p>- Experience with Confluent Kafka Enterprise or Redpanda for high-performance streaming.<br/><br/></p><p>- Hands-on knowledge of Kafka Tiered Storage and Cloud-native Kafka deployments.<br/><br/></p><p>- Knowledge of workflow orchestration tools like Apache Airflow, Prefect, or Dagster.<br/><br/></p><p>- Contributions to open-source Kafka/Flink/Spark projects</p><br/></p> (ref:hirist.tech)


Required Skill Profession

Supervisors Of Office And Administrative Support Workers



Your Complete Job Search Toolkit

✨ Smart • Intelligent • Private • Secure

Start Using Our Tools

Join thousands of professionals who've advanced their careers with our platform

Rate or Report This Job
If you feel this job is inaccurate or spam kindly report to us using below form.
Please Note: This is NOT a job application form.


    Unlock Your Kafka Administrator Potential: Insight & Career Growth Guide