Level 3 · Expert
Large, small, open and closed models
You don't take a truck to the corner store.
Not every task needs the biggest model. To sort emails or pull data from an invoice, a small model is faster and much cheaper.
There are also closed models (used as a service, like going to a restaurant) and open models (you can run them on your own infrastructure, like having the recipe). One gives convenience; the other, control.
Try it today
Do the same simple task on a large and a small model (many apps let you choose). Do you notice a difference?
Test yourself
What's the main advantage of an open model?
- It's always smarter
- Control over where it runs and what happens to the data
- It costs nothing to run
See the answer
Control over where it runs and what happens to the data. You gain control, but someone has to run it: servers, updates and security.
If you lead a team
Ask whether the solution uses one model for everything. Mixing models by task often cuts cost a lot.