You can go your way: Kafka without Zookeeper

Day 3 /  / Track 3  /  RU / For practicing engineers

Very soon, Apache Kafka® will no longer need ZooKeeper! With KIP-500, Kafka will include its built-in consensus layer, removing the ZooKeeper dependency altogether. The next significant milestone in this effort is coming in Apache Kafka 2.8.0. You will have early access to the new code and spin up a development version of Kafka without ZooKeeper's opportunity to play with the Raft implementation as the distributed consensus algorithm.

Ultimately, removing ZooKeeper simplifies overall infrastructure design and operational workflows for your Kafka deployments. In this talk, Viktor will provide a brief overview of what limitations Zookeeper imposed on Kafka architecture, what will be changed, and the current status of Zookeeper removal.



Speaker(s)

Victor Gamov
Confluent

Viktor Gamov is a Developer Advocate at Confluent, the company that makes an event streaming platform based on Apache Kafka. Back in his consultancy days, Viktor developed comprehensive expertise in building enterprise application architectures using open source technologies. He enjoys helping architects and developers to design and develop low latency, scalable and highly available distributed systems. He is a professional conference speaker on distributed systems, streaming data, JVM and DevOps topics, and is regular on events including JavaOne, Devoxx, OSCON, QCon, and others. He co-authored O'Reilly's "Enterprise Web Development". He blogs at http://gamov.io and co-hosts DevRelRad.io. Follow Viktor on Twitter @gamussa, where he posts there about gym life, food, open source, and, of course, Kafka and Confluent!

Invited Experts

Anatoly Soldatov
Anatoly Soldatov
Unity

Worked as DBA and then as PostgreSQL team lead. Former lead engineer at Avito where he raised Kafka from the scratch. Now Anatoly is building ETL at Unity in Helsinki, consulting on Kafka and preparing a course on it for Slurm.