Bringing Deep Learning into the Big Data...

Deep Learning is rapidly spreading as one of the most successful and widely applicable set of techniques across a range of applications (vision, language, speech, computational biology, robotics, etc.), leading to some significant commercial success. While the cutting-edge researches emerging in a breathtaking speed, from industry we often see the gaps from papers to prototypes, and even larger gaps between prototypes and production. In this talk, we present several key deep learning applications we built successfully with BigDL, an arising distributed deep learning framework on Apache Spark. For perception applications, we will introduce the object detection pipeline with SSD and how it’s used in production scenarios. For industry applications, we’ll present the neural recommendations system and fraud detection system we built with BigDL and Spark ML pipeline.