BDSBTB 2015: Lee Mighdoll, The Live Layer and The Lambda Architecture

How can we take advantage of fast storage systems and fast computational substrates in our big data pipelines? In this talk we’ll propose a ‘Live Layer’ that can solve key problems in the Lambda Architecture by combining fast storage with fast compute. Our Sparkle data visualization system uses a Live Layer. We’ll show some data visualizations, and discuss how Sparkle takes advantage of Cassandra, Spark, and reactive streams.

▶