Can I run llama2 13B locally on my Gtx 1070? I read somewhere minimum suggested VRAM is 10 GB but since the 1070 has 8GB would it just run a little slower? or could I use some quantization with bitsandbytes for example to make it fit and run more smoothly?

Edit: also how much storage will the model take up?

  • frontenbrecher@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    use koboldcpp to split between GPU/CPU with gguf format, preferably a 4ks quantization for better speed. I am sure that it will be slow, possibly 1-2 token per second.