Since their introduction, transformers have had an enormous impact on the state of the art for many natural language tasks. This talk discusses the transformer architecture and how to fine-tune transformers on SageMaker instances for different applications, including their use in Autodesk's Digital Help organization.