You can go your way: Kafka without Zookeeper

Day 3 /  / Track 3  /  RU / For practicing engineers

Very soon, Apache Kafka® will no longer need ZooKeeper! With KIP-500, Kafka will include its built-in consensus layer, removing the ZooKeeper dependency altogether. The next significant milestone in this effort is coming in Apache Kafka 2.8.0. You will have early access to the new code and spin up a development version of Kafka without ZooKeeper's opportunity to play with the Raft implementation as the distributed consensus algorithm.

Ultimately, removing ZooKeeper simplifies overall infrastructure design and operational workflows for your Kafka deployments. In this talk, Viktor will provide a brief overview of what limitations Zookeeper imposed on Kafka architecture, what will be changed, and the current status of Zookeeper removal.

Download presentation


Victor Gamov

Viktor Gamov is a Developer Advocate at Confluent, the company that makes an event streaming platform based on Apache Kafka. Back in his consultancy days, Viktor developed comprehensive expertise in building enterprise application architectures using open source technologies. He enjoys helping architects and developers to design and develop low latency, scalable and highly available distributed systems. He is a professional conference speaker on distributed systems, streaming data, JVM and DevOps topics, and is regular on events including JavaOne, Devoxx, OSCON, QCon, and others. He co-authored O'Reilly's "Enterprise Web Development". He blogs at and co-hosts Follow Viktor on Twitter @gamussa, where he posts there about gym life, food, open source, and, of course, Kafka and Confluent!

Invited Experts

Anatoly Soldatov
Anatoly Soldatov

Worked as DBA and then as PostgreSQL team lead. Former lead engineer at Avito where he raised Kafka from the scratch. Now Anatoly is building ETL at Unity in Helsinki, consulting on Kafka and preparing a course on it for Slurm.