I originally found and read this article on my RSS feed, and it actually pissed me off by how badly written it is and how many times it pretty much says “noooo, you don’t need a diagnosis, you’re just acting weird!”

So what you’re saying is, we have a chance?

Actually, I agree. And so far, small local models are really solid, and can punch above its weight even when compared to frontier models.

I believe what I meant when I said I doubted it was since these AI corpos seemingly give no indication that local is an option, so most people would think they can only access an LLM through the web. This would bolster the SaaS ecosystem dominating over local AI, although local will keep increasingly growing as a more favourable option.

Although I do agree that the industry will shift from being server based to PC based inference as well, I don’t see that shift being large enough to make these companies change their training paradigms to include telemetry from local AI, but I’m sure some will.

I doubt it, but honesty, many systems can do inference pretty well, like how I ran the MLX version of Qwen 3 4b with a DuckDuckGo search RAG, and used it to ask quick questions and verify some simple things, running on a MacBook Air m2 16gb, and barely made a dent in the RAM utilisation or SoC, and this also goes for my much less powerful machines, like even a galaxy a20, with 3gb of memory and a low spec octacore exynos, can run small models really well, although the quantisation needs to be a bit strict.

Finally, something that can open the windows 11 start menu without stuttering, we sure are in the future huh