Which LLM to use for your AI Agent?
Recording: Which LLM to use for your AI Agent?
If you ask them, "Okay, which model should I use for this task?" They may be able to give you some suggestions. You know, nobody may always remember or stay up-to-date as new models get released. Almost week by week and know which one is the best for the task. Two things I would suggest here. One is that's why we try to make it very easy at to me based on the task to suggest you, "Here's the right model family or even size." If you're building a classifier for this use case, yeah, likely you don't need a model that is more than 4 billion, for example. Or if you want something that runs on device, maybe you should go for a sub-billion model. So, it makes all these recommendations for you. But, the thing I would say is quite often the best thing is to experiment
You may say, "Okay, I'm not going to try perhaps some old Llama model, but between the latest, say, Qwen 3.6 or the Gemma 4, it may be worthwhile to try both of them." And because often sometimes, you know, even our intuition or whatever other things may fail us, so that's why sometimes it's good to test them. And that's why we make it very easy, so you can compare in the same consistent way side by side. And you can even say to the agent, "I want to evaluate Qwen 3.6 and Gemma 4 on this task." And it will automate everything. So, it's often that's the best way to, if you want to really make sure that you're getting the best one.