minus-squareHuman-Most-6115@alien.topBtoLocalLLaMA@poweruser.forum•Venus-120b: A merge of three different models in the style of Goliath-120blinkfedilinkEnglisharrow-up1·10 months agoIt seems like my duel rtx 4090 setup just falls short of memory to load it up, where Goliath loads fine on the 3.0 bpw model. linkfedilink
It seems like my duel rtx 4090 setup just falls short of memory to load it up, where Goliath loads fine on the 3.0 bpw model.