• LocoLanguageModel@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Try Setting temperature to .1

    Ive had really good luck with this model for 6.7b and and 33b. The 1.3 is more of a novelty because of how fast it runs on ancient GPUs, but not nearly as good as the other 2 sizes in my attempts, though it is amazing for its size.