Apache Spark NYC Meetup August 2026
Join us for another great evening of practical technical sessions, real-world lessons from the field, and open discussions around the Future of Data Infrastructure This NYC Spark meetup brings together data engineers, platform teams, and anyone who's spent too many hours staring at the Spark UI. Two talks on where Spark performance is headed - one on modernizing what you already run, one on what's coming next in Spark itself. Food, drinks, and time to trade stories with people who actually enjoy talking about shuffle skew. 🔔 Seats are limited, RSVP soon to secure your spot! ⚠️ Important This event has limited capacity and registration is subject to approval. Datadog requires your full name for office entry - please ensure your profile on this website includes it, or entry will not be permitted. A valid ID is also required for building access. Agenda: 5:30 PM – Mingling, name tags, pizzas & beers 6:00 PM – Meetup talks: What's new in Spark 4.2- by Meni Shmueli Co-founder & CEO (DataFlint) 850 Engineering Hours Back, Every Month: Context-Aware Agentic Platform for Airflow & Spark at Wix - by Yarden Wolf, Data Engineer & AI Tech Lead at Wix. Modernizing Spark: Performance Boost Without Rewrite - by Shehab Amin, Co-founder & CEO (LakeSail) 7:30 PM – Networking and mingling 8:00 PM – Wrap it up
Talks & recordings
3 connected sessions
850 Engineering Hours Back, Every Month: Context-Aware Agentic Platform for Airflow & Spark at Wix
Yarden Wolf, Data Engineer and AI Tech Lead at Wix, presents a context-aware agentic platform for Apache Airflow and Apache Spark at Wix.
Spark Rebuilt In Rust: Making The Data Engine AI-Native
Shehab Amin of LakeSail presents Sail, a Spark Connect-compatible data engine written entirely in Rust. Sail keeps the familiar Spark SQL and DataFrame interfaces while replacing the JVM-based runtime with an Arrow-native architecture powered by Apache DataFusion, running Python UDFs in-process with shared Arrow memory and integrating natively with Delta Lake, Iceberg, and DuckLake.
What's new in Spark 4.2
Meni Shmueli, co-founder and CEO of DataFlint, presents what is new in Apache Spark 4.2.
Connections
7 relationships