talk · community record
Adding Custom Optimizations to Catalyst...
Learn how the Datastax Spark Connector is wiring directly into Spark Internals to bring even more speed to users automatically! Find out how Catalyst actually interacts with Data Sources and the key locations which require modification in order to introduce custom behavior. Find out how writing a new Strategy and Execution nodes for catalyst actually works in practice! Come learn about our most recent optimizations and how they can directly benefit you or pick up some tips about writing your own custom optimizations!