SBTB 2023: Ofer Mendelevitch, Why do LLMs hallucinate?

ai.bythebay.io Nov 2025, Oakland, full-stack AI conference After ChatGPT took the industry by storm, everyone is now working to implement LLM-powered application and trying to understand how to best apply this incredible innovation within their own business and to benefit their customers. One of the key issues with LLMs is hallucination, the tendency of large language models to make up responses that could be inaccurate or even completely incorrect. In this talk I will discuss why hallucination occurs, and some of the ways to address it, including retrieval augmented generation (or grounded-generation). Finally I'll show a demo of an LLM-powered app for asking questions about recent news, that uses Grounded Generation to mitigate hallucination. More details available here: https://www.scale.bythebay.io/post/ofer-mendelevitch-why-do-llms-hallucinate