The Live Layer and The Lambda Architectu...

How can we take advantage of fast storage systems and fast computational substrates in our big data pipelines? In this talk we’ll propose a ‘Live Layer’ that can solve key problems in the Lambda Architecture by combining fast storage with fast compute. Our Sparkle data visualization system uses a Live Layer. We’ll show some data visualizations, and discuss how Sparkle takes advantage of Cassandra, Spark, and reactive streams.