Dhalion: towards self-regulating stream processing

Presented as Senior Scientist at Microsoft, with Ashvin Agrawal. Introduces self-regulating streaming systems and the Dhalion framework built on Twitter Heron, with policies that automatically reconfigure topologies to meet throughput SLOs and scale resource consumption up and down.