Looking for any model that can run with 20 GB VRAM. Thanks!

  • BlueMetaMind@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Best experience I had was with TheBloke/Wizard-Vicuna-30B- Uncensored-GGML

    Best 30B llm so far in general. Censorship kill’s capabilities