I tried local AI models and have indeed bought a MacBook so that I can test them. But whoa, even with a powerful machine, it ended up really slowing it down. I am gonna try again with probably a smaller model this time.
Thank you! I really think the SLM conversation is going to get a lot louder once people realize how easy it is to connect your existing tools around a smaller model.
I tried local AI models and have indeed bought a MacBook so that I can test them. But whoa, even with a powerful machine, it ended up really slowing it down. I am gonna try again with probably a smaller model this time.
That's the most common first experience. Smaller model usually fixes it, and quantization matters even more than size. DM me if you need to!
The teams who planned for this didn't panic last weekend.
There are more and more conversations about Small Language Models for a reason… Great piece
Thank you! I really think the SLM conversation is going to get a lot louder once people realize how easy it is to connect your existing tools around a smaller model.