I use in both cases q4_K_M

  • bacocololo@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    To stop any repetition. you could try to add a stop token in model as ‘### Human’ it works well for me

    • TeamPupNSudz@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 months ago

      Capybara doesn’t use Alpaca format, so that wouldn’t do anything. Regardless, it’s not that type of repetition. It’s not speaking for the user, it’s literally just copy/pasting part of the conversation into the answer.