Debugging Apache Spark

Joint session with Holden Karau on debugging Spark applications — why lazy evaluation and pipelining make debugging harder, logging options across Spark's supported languages, searching Spark's verbose logs, and common errors and how to detect them.