I use in both cases q4_K_M

  • Sunija_Dev@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    90% of the time a bigger model is “worse” because…

    A) I messed up the prompt format

    B) (For roleplaying) Smaller models seem more creative, because they’re less consistent. But after some messages, the missing consistency makes them really bad.