Fluboxer@alien.topBtoLocalLLaMA@poweruser.forum•I’m extremely confused about system requirements. Some people are worried about ram and others about vram. I have 64gb of ram and 12gb vram. What size of model can I run?English
1·
10 months ago7b and 13b fully in vram. 7b models have 35, 13b have 43 layers iirc
70b involving ram
Depends on what you have to backup
I backup some stuff I don’t really care about yet don’t want to be bothered recovering in cloud, in encrypted archives