talk · community record
AI-native Spark Ecosystem in Rust
Sail is the complete rebuild of Apache Spark from the ground up in Rust. Started by LakeSail co-founders Shehab Amin and Heran Lin, who present the talk, Sail integrates natively with Delta and Iceberg tables and catalogs and innovates at all levels of the stack, using Apache DataFusion, Apache Arrow, and Flight SQL, a Celeborn shuffle reborn in Rust, and an actor architecture.
01
Connections
11 relationships
discusses · incomingNotes from the first Rust AI meetup in Europe, at Adyentalk ↗featuresApache Arrowproject ↗featuresApache DataFusionproject ↗featuresApache Icebergproject ↗featuresApache Sparkproject ↗featuresDelta Lakeproject ↗featuresSailproject ↗presented · incomingHeran Linperson ↗presented · incomingShehab Aminperson ↗presented atRust, Data and AI at Adyenevent ↗representedLakeSailcompany ↗