One of the biggest issues I've faced as a dev is actually knowing which LLM I need to use. And it's not just limited to the model accuracy, which is just one of the bazillion other factors. While I'm not dismissing it, you just can't use GPT-6 Astra for every single LLM call. It's kind of an untold rule if you use a lot of LLM calls in your application: you use the lighter models for interactions with the end user, while keeping the heavier ones for actual work.
With agentic workflows increasing every passing day, you can easily have 10s to 100s of LLM calls for just 1 part of the application, starting with data-processing to structural validation, from decision making to actual hallucination preventers and final responses. A good example is an art analysis application where the user inputs their artwork, and you point out issues and help them improve.
You will need LLM calls in every corner of the application.…