30,000 AI models
too many really. But from what I read in conversations and posts I notice one thing: you all try out Model all the time and that’s fine, but I haven’t yet read that anyone habitually uses one Model over others. It seems like you use one template for a few days and then start with a new one. Don’t have your favorite? Which?
You dont talk about the “usuals”.
My go to models were for a long time Stable Beluga 2 13B and 70B.
Then, 13B got replaced by Minstral, 70B by LZLV, and Airoboros Yi 34B came out that worked great for me.
As a rule: 7B - CPU inferencing on 2-4 cores while using GPU.
34B and 70B, GPU inferencing, models trade blows despite size diff, as they are different base models. (Llama vs Yi).