Small Model Revolution

In early 2023, the AI world was obsessed with scale. GPT-4 had just been released with an estimated 1.7 trillion parameters. The narrative was clear: bigger models are better models, and only the wealthiest companies could participate. Eighteen months later, that narrative has been thoroughly upended.