minus-squareyeawhatever@alien.topBtoLocalLLaMA@poweruser.forum•Quantizing 70b models to 4-bit, how much does performance degrade?linkfedilinkEnglisharrow-up1·1 year agoabout 44 GB linkfedilink
about 44 GB