I decided to explore using a local 3 B parameter model for many tasks, building a prompt‑handling layer to compensate for its lower tolerance to bad prompts, instead of renting frontier models for every call.
Everyone’s renting frontier models for jobs a local 3B model could do. Small Local LLM's are the future.
It's "which of my 1000 calls ever needed the smart one?"