Set aside benchmarks, if you had to choose one to use instead of ChatGPT for the next 6 months, which one would you pick? Recently, I’ve been experiencing some extreme slow down and poor answers on GPT so I’m going to run a local backup for the time being to assist when GPT4 is down. I’m leaning towards Mistral. I can be convinced to test some others, though.

  • RiotNrrd2001@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I keep trying new models, and I keep going back to Dolphin-Mistral-2.2.1. There is something about the quality of the interactions that is different from the other models, and is, I don’t know, unexplainably better. I cannot identify why this remains in my mind the best model of all models I’ve tested, clear up to 33b (the largest my pitiful machine will load), but I continue to think this. Now, I haven’t tested every model, so my opinion is completely anecdotal. Dolphin just kicks it, though. It just does such a good job at almost everything I throw at it. I won’t say it doesn’t foul up here and there, but it still blows the other small models out of the water as far as I’m concerned.