talk · community record
PySpark Beyond Shuffling: Why It Isn't Magic and Where the Magic Actually Is
Deep dive into PySpark performance, understanding when and why shuffles happen, what optimizations are possible, and where PySpark's real magic lies for data engineers and scientists.
01
Connections
6 relationships
aboutApache Sparkproject ↗aboutPySparkproject ↗affiliated withSpark Technology Centercompany ↗presented · incomingHolden Karauperson ↗presented at[Eventbrite] Spark, Watson and Einstein: Spark.TC, Salesforce and RStudio!event ↗recorded assfspark.org: Holden Karau, PySpark Beyond Shuffling -- Why it isn't Magicvideo ↗