Is there a technical reason they begin with “You are” and not “You’re” or is it just an oversight?

18-21

Assume it’s all marketing unless proven otherwise

This seems like something that would be difficult to predict considering how fundamental what your changing is. The method you use to quantize it and how refined it is also matters a great deal.

Try this for a prompt and go from there: “Describe yourself in detail.”

What’s your context and batch size? Using llama.cpp 1024 B context & 1024 B batch it acted like you described.

With a context and batch size of 1536B it performed as expected. openorca/mistral 7B

Congratulations! You’ve graduated from Windows. Time to upgrade.

IMO mistral-7B-orca, jazzing it up by telling it it’s a subject matter expert and not to guess seems to help too

https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca