Loading devreal.ai…

Community index online

Built for the people who make technology make sense.

The First Spark1st Spark meetup in the worldRelive the miracle of discovering Spark! ↗

Alexy is goingSF Apache DataFusion Meetup · Aug 13Event details ↗

New on FunctionalTVRust AI Begins recordings are liveWatch all 12 ↗

DIY LLMs with Modal — devreal.ai

← Back to the graph

talk · community record

DIY LLMs with Modal

Running your own LLMs is harder than making an API call, but sometimes hard things are worth doing. Tips and tricks for self-hosting LLM inference using Modal, where provisioning GPUs is just an API call.

Watch on YouTube ↗Add or suggest a connection ↗

Connections

6 relationships

aboutModalproject ↗affiliated withModalcompany ↗documented byBay Area AI 20250123photo ↗presented · incomingCharles Fryeperson ↗presented at[registration required on lu.ma/_ai] Full Stack OSS AI: Chips to Apps!event ↗recorded asDevReal: DIY LLMs with Modal, Charles Fryevideo ↗

Provenance

Type: talk
Status: Imported / unclaimed
date: 2025-01-23
type: talk
title: DIY LLMs with Modal
video: https://www.youtube.com/watch?v=_Y7lURuvmPM
origin: meetup
source: bythebay
video Id: _Y7lURuvmPM
abstract: Running your own LLMs is harder than making an API call, but sometimes hard things are worth doing. Tips and tricks for self-hosting LLM inference using Modal, where provisioning GPUs is just an API call.