Apache Spark NYC Meetup August 2026
A connected record in the developer community graph.
Talks & recordings
5 connected sessions
850 Engineering Hours Back, Every Month: Context-Aware Agentic Platform for Airflow & Spark at Wix
Yarden Wolf, Data Engineer and AI Tech Lead at Wix, presents a context-aware agentic platform for Apache Airflow and Apache Spark at Wix.
Adam de Delva, DTR — Interview with Alexy
Alexy Khrabrov talks with Adam de Delva of DTR (Developer Technology Research) in New York after the Apache Spark NYC meetup at Datadog. They discuss growing a network of open-source communities from 30,000 to over three million members, with new communities in Ghana and Latin America; open-source sustainability and getting companies to reinvest in the commons; digital public infrastructure and sovereign AI, from mapping workloads onto neoclouds to scheduling containers securely in trustless environments with the Linux Foundation Decentralized Trust and Hyperledger communities; and the UOR (Universal Object Reference) Foundation, where specs, protocols, and standards for sovereign AI infrastructure are built.
Spark Rebuilt In Rust: Making The Data Engine AI-Native
Shehab Amin of LakeSail presents Sail, a Spark Connect-compatible data engine written entirely in Rust. Sail keeps the familiar Spark SQL and DataFrame interfaces while replacing the JVM-based runtime with an Arrow-native architecture powered by Apache DataFusion, running Python UDFs in-process with shared Arrow memory and integrating natively with Delta Lake, Iceberg, and DuckLake.
What's new in Spark 4.2
Meni Shmueli, co-founder and CEO of DataFlint, presents what is new in Apache Spark 4.2.
Yarden Wolf, Wix — Interview with Alexy
Alexy Khrabrov talks with Yarden Wolf, Data Engineer and AI Tech Lead at Wix, at the Apache Spark NYC meetup at Datadog. They discuss how agentic workflows change the work of Wix's software engineers, data scientists, and analysts while keeping a human in the loop for production alerts; Base, Wix's app-building platform, and Wix Harmony, which combines vibe coding with drag-and-drop editing; authentication and AI gateways for internal agents; specialized internal agents such as Airbot for Airflow alerts and a root-cause-analysis agent working together; and Wix Headless, which lets a coding agent build a site's backend on Wix.
Connections
12 relationships