talk · community record

Building a Machine Learning Orchestratio...

A scaleable and adaptable machine learning platform is essential for an organization to harness the full potential of their data. This talk introduces Meson, a General Purpose Workflow Orchestration and Scheduling framework. Meson is a Scala application that manages heterogeneous workloads integrating Spark, Python, R, Docker and other toolkits. We will demonstrate how a simple user interface and a DSL allows data scientists to design and run machine learning pipelines that seamlessly exchange data and artifacts between disparate jobs. We are working on open sourcing Meson and by this talk it may very well be open sourced.

Add or suggest a connection ↗

01

Connections

7 relationships

aboutDockerproject ↗affiliated withNetflixcompany ↗affiliated withNetflix Inccompany ↗presented · incomingDavis Shepherdperson ↗presented · incomingKedar Sadekarperson ↗presented atScala by the Bayevent ↗recorded asscala.bythebay.io: Davis Shepherd, Building a Machine Learning Orchestration Framework in Scalavideo ↗

02

Provenance

Type: talk
Status: Imported / unclaimed
id: talk:scalaebythebay2016-7iv1-fdd0
date: 2016-11-13
type: talk
title: Building a Machine Learning Orchestratio...
venue: Off by One
origin: conference
source: bythebay
abstract: A scaleable and adaptable machine learning platform is essential for an organization to harness the full potential of their data. This talk introduces Meson, a General Purpose Workflow Orchestration and Scheduling framework. Meson is a Scala application that manages heterogeneous workloads integrating Spark, Python, R, Docker and other toolkits. We will demonstrate how a simple user interface and a DSL allows data scientists to design and run machine learning pipelines that seamlessly exchange data and artifacts between disparate jobs. We are working on open sourcing Meson and by this talk it may very well be open sourced.

Loading devreal.ai…

Connections