Scaling to the Future: What it Really Takes to Train Your Own LLM from Scratch

Talk 2 of the March 13, 2024 multi-cluster meetup co-hosted with MosaicML/Databricks; Ajay Saini (MosaicML/Databricks) on the infrastructure needed to train LLMs from scratch.