minus-squareageorgios@alien.topBtoLocalLLaMA@poweruser.forum•Macs with 32GB of memory can run 70B models with the GPU.linkfedilinkEnglisharrow-up1·10 months ago85% of 32GB RAM would be 27200MB I have no prior knowledge of the command though linkfedilink
85% of 32GB RAM would be 27200MB
I have no prior knowledge of the command though