NousResearch/Nous-Capybara-34B · Hugging Face
huggingface.co
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
  • mcmoose1900@alien.topOPBEnglish
    1·
    1 year ago

    Precisely 47K fits in 24GB at 4bpw.

    I have not tried 3.5, but I think it could be much more.