talk · community record
Akka Streams for Large Scale Data Proces...
With over 50 million members, Credit Karma is the most utilized and trusted personal finance platform in the U.S. To handle tens of millions of Americans’ credit information, we use Akka Streams for high throughput data transfer. We will discuss how we quickly built a solution using Akka Actors to help us parallelize, parse and send data to our ingestion service. We then used Akka Streams to pull data through our actors based on demand, allowing us to easily control our memory buffers and prevent Out of Memory issues. Akka Streams also allowed us to apply parsing and simple business logic. In this panel, Credit Karma shares best practices on how to implement Akka Streams at scale.
01
Connections
7 relationships
aboutAkka Streamsproject ↗affiliated withCredit Karmacompany ↗documented byData-2016-05-16photo ↗presented · incomingDustin Lyonsperson ↗presented · incomingZack Loebel-Begelmanperson ↗presented atData by the Bayevent ↗recorded asdata.bythebay.io: Zack Loebel-Begelman • Dustin Lyons, Akka Streams for Large Scale Data Processingvideo ↗