sfspark.org: Holden Karau, PySpark Beyond Shuffling -- Why it isn't Magic

Deep dive into PySpark performance, understanding when and why shuffles happen, what optimizations are possible, and where PySpark's real magic lies for data engineers and scientists.

▶