Kafka Administrator

Role overview

We are looking for a seasoned Kafka Administrator to run and support enterprise Apache Kafka environments. This role focuses on keeping clusters stable, secure, and performant across distributed systems while supporting real-time data streaming and integration needs.

Core responsibilities

• Set up, configure, and maintain Apache Kafka clusters in production environments.
• Administer brokers, topics, partitions, and replication settings.
• Handle cluster expansion, upgrades, and future capacity planning.
• Track cluster health and performance using observability tools such as Prometheus, Grafana, and Confluent Control Center.
• Improve throughput, latency, and broker efficiency through configuration tuning.
• Support producer and consumer performance optimization.
• Operate streaming pipelines and event-driven data flows built on Kafka.
• Work with integration ecosystems involving Spark, Hadoop, Flink, databases, and APIs.
• Implement security controls including SSL, SASL, Kerberos, and access control lists.
• Maintain safe data transmission practices and compliance-oriented governance.
• Ensure reliability, replication, and fault tolerance across brokers and clusters.
• Support multi-cluster architectures such as MirrorMaker and Cluster Linking.
• Contribute to disaster recovery planning and execution.
• Investigate incidents such as broker outages, consumer lag, and performance degradation.
• Review logs, perform root-cause analysis, and close operational issues.
• Automate deployments and environment setup using Ansible, Terraform, or scripting.
• Support CI/CD pipelines for Kafka-related infrastructure and releases.
• Use Git for version control and configuration management.
• Administer Zookeeper environments where required.
• Work with Kafka in KRaft mode for Zookeeper-less deployments.

Additional information

• Primary skill required: Kafka administration.
• Experience with the Confluent Platform is desirable.
• Knowledge of Kubernetes-based Kafka deployments is an advantage.
• Exposure to DevOps tooling and CI/CD workflows is helpful.
• Kafka or Confluent certification is considered a plus.