OpenHermes-2.5-Mistral-7B-16k imo

Your wish has apparently been granted
https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-7b-v3-1-7B
https://huggingface.co/TheBloke/OpenHermes-2.5-neural-chat-7B-v3-1-7B-GGUF

On another note these gpu manufactures must get their head out of their ass and start cranking out cards with much higher memory capacities. First one to do it cost effectively will gain massive market share and huge profits. Nvidia’s A100 etc doesn’t qualify for this as it’s prohibitively expensive.

Check this out https://github.com/ggerganov/llama.cpp#mpi-build