Scale By The Bay 2019: Oscar Boykin, Scoring ONNX ML Models with Scala

ai.bythebay.io Nov 2025, Oakland, full-stack AI conference ONNX is an emerging standard format for serializing machine learning models. This talk will introduce Agate, Stripe's library for scoring ONNX models on the JVM in pure Scala. Stripe uses Agate to score deep learning models in batch in spark and scalding, and also in real-time using our scala-based scoring service. We'll talk about performance, how Agate was developed, and how we use graal native-image built binaries to interop with python. Oscar Boykin Machine Learning Infrastructure, Stripe Oscar is the creating of Scalding, Summingbird, and Algebird, and is an overall professor and mathematician turned software magician.