Gryphe, creator of MythoMax basically merged the best Mistral models together. This should be a really fantastic model!
https://huggingface.co/Gryphe/MythoMist-7b (links to quantized models by TheBloke can be found there)
Edit: oof, messed up the title. It’s MythoMist, not Mix.
+1 on the fact that I have infrequently seen my own merge experiments spit out “### Reponse:” while using the standard Alpaca format. It so far hasn’t happened enough times to be a concern. I’ve seen more benefits than deficits when it comes to merging models overall however. I’m coming at this primarily from a creative writing aspect, so I’ll usually find models that have characteristics I enjoy, merge them together, and then continue merging models down the line to experiment with output quality.