• GasBond@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    TheBloke openhermes 2.5 mistral 16k 7B q5_k_m gguf. what about this? anyone using this model?

    • LoSboccacc@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 months ago

      I am using it, my favorite finetune so far, however, ignore the instructions to use chatml prompt formattig and use instead vicuna, with USER: and ASSISTANT:, possibly one of the best model I’ve seen for long conversation