LLM Avalance: Anshul Ramachandran: The things we learned while building a successful LLM application

ai.bythebay.io Nov 2025, Oakland, full-stack AI conference It turns out the model is just one small sliver in building a differentiated LLM application that you can sustainably make money from. In this lightning talk, we will discuss the breadth of considerations from UX to product scaling to infrastructure that we had to reason through while building Codeium, which in six months, has added over 100k active users and a number of paying customers, from startups to Fortune 500 companies.