data.bythebay.io: Zack Loebel-Begelman • Dustin Lyons, Akka Streams for Large Scale Data Processing

With over 50 million members, Credit Karma is the most utilized and trusted personal finance platform in the U.S. To handle tens of millions of Americans’ credit information, we use Akka Streams for high throughput data transfer. We will discuss how we quickly built a solution using Akka Actors to help us parallelize, parse and send data to our ingestion service. We then used Akka Streams to pull data through our actors based on demand, allowing us to easily control our memory buffers and prevent Out of Memory issues. Akka Streams also allowed us to apply parsing and simple business logic. In this panel, Credit Karma shares best practices on how to implement Akka Streams at scale.

▶