Hey everyone,

Looking to get into some ML.

Can a GTX 4070ti with 12gb VRAM alongside 32gb ram run 13b comfortably?

I seem to read conflicting opinions on this.

Thank you!

  • zodireddit@alien.topBEnglish
    1·
    1 year ago

    I’m no expert in this but I’m using a 13b llama 2 model I’m happy with, with just a 3060 and it runs fine. It’s probably not the raw model but it’s pretty good. I also have 32gb of ram