video · community record

DevReal: DIY LLMs with Modal, Charles Frye

Name: DevReal: DIY LLMs with Modal, Charles Frye
Description: Running your own LLMs is harder than making an API call, but sometimes hard things are worth doing. Tips and tricks for self-hosting LLM inference using Modal, where provisioning GPUs is just an API call.

Running your own LLMs is harder than making an API call, but sometimes hard things are worth doing. Tips and tricks for self-hosting LLM inference using Modal, where provisioning GPUs is just an API call.

Open on YouTube

Watch on YouTube ↗Add or suggest a connection ↗

01

Connections

2 relationships

recorded as · incomingDIY LLMs with Modaltalk ↗published · incomingFunctionalTVcompany ↗

Loading devreal.ai…

Connections