Set aside benchmarks, if you had to choose one to use instead of ChatGPT for the next 6 months, which one would you pick? Recently, I’ve been experiencing some extreme slow down and poor answers on GPT so I’m going to run a local backup for the time being to assist when GPT4 is down. I’m leaning towards Mistral. I can be convinced to test some others, though.
Just one, and assuming no extra training? I think I’d go with Capybara Tess Yi 34b. In part because of how well it seems to follow instructions. But also because it has the broadest scope of knowledge that I’ve seen in any of the models so far. A lot of the models tap out on a lot of things past what you’d get from the first paragraph of Wikipedia. I get that feeling far less often with capy so far.
This!