minus-squareMiniEval_@alien.topBtoLocalLLaMA@poweruser.forum•Quantizing 70b models to 4-bit, how much does performance degrade?linkfedilinkEnglisharrow-up1·10 months agoDual 3090/4090s. Still pricey as hell, but not out of reach for some folks. linkfedilink
Dual 3090/4090s. Still pricey as hell, but not out of reach for some folks.