Managing Kafka, the easy way, with help...

We will look at a brief intro of Kafka and some of the challenges of maintaining a cluster. We'll then look at operations concerns around adding new nodes to the cluster, swapping out nodes in the cluster, or removing nodes from the cluster and how the Kafka Manager makes this easier. There is no out of the box UI for Kafka which explains the level of interest we've seen for Kafka Manager. It is the 4th most popular project on Yahoo's public github account. Then we'll delve into the internals of Kafka Manager and how it was built around Play Framework, Akka, and Apache Curator. We'll talk about how we use the in-memory state for making some operations quick and what's upcoming/future work.