Devreal

Scale By the Bay 2023 intro video by Ryan Wright

Scale By the Bay 2023 intro video by Ryan Wright

Recording: Scale By the Bay 2023 intro video by Ryan Wright

hi I'm Ryan Wright and I want to give you an introduction to my talk at the upcoming scale by the bay conference called streaming Graph Search the basic idea behind streaming Graph Search is that if you've got a data pipeline a stream of events coming through and you need to analyze those events to find complex patterns in there which means more than one record in that stream how do you do it so finding a complex pattern is not just a matter of aggregating results or counting how many times you've seen something instead it requires joining one event to another event and maybe joining that to another event and so on it's really recursive joins on an infinite stream of data it's a powerful tool but it's very often very expensive to implement using uh traditional old school methods I want to introduce some new open source tools and show you how to use them for the sake of doing streaming graphs search on your data streams and in your data that allows you to search while streaming and the results that you find also stream out now this does away with the convention of using time windows and it can handle outof order data arriving U from multiple different streams if need be um it's very difficult to implement in other ways and I'll show you some of the popular use cases uh that are getting traction for applying streaming Graph Search in modern data Pipelines so I hope to see you at the talk again my name is Ryan Wright and the talk is on streaming Graph Search I'll see you there