Twitter Heron in Practice

Twitter generates billions and billions of events per day. Analyzing these events in real time presents a massive challenge. Twitter designed and deployed a new streaming system called Heron. Heron has been in production nearly 2 years and is widely used by several teams for diverse use cases. In this talk, I will describe Heron in detail and share our operating experiences and challenges of running Heron at scale.