Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines

Bing's monetization pipeline is one of the largest and most critical streaming workloads deployed in Microsoft's internal data lake. The pipeline runs 24/7 at a scale of 3500 YARN containers and is required to meet a Service Level Objective of low tail latency.