Set aside benchmarks, if you had to choose one to use instead of ChatGPT for the next 6 months, which one would you pick? Recently, I’ve been experiencing some extreme slow down and poor answers on GPT so I’m going to run a local backup for the time being to assist when GPT4 is down. I’m leaning towards Mistral. I can be convinced to test some others, though.
There is an upcoming NeuralHermes-2.5-Mistral-70B, chances are it will also have vision version as well. Looking at really impressive performance of 7B version. I think 70B will set new benchmarks in OSS AI world. But, there are plenty of other models as well. You should choose according to your use case.