minus-squaremolbal@alien.topBtoLocalLLaMA@poweruser.forum•What kind of mini PC can handle a local LLM?linkfedilinkEnglisharrow-up1·1 year agoHow about a Zotac zbox? ZBOX QRP7N3500 Max supported memory is 64GB and it has an RTX3050 with 12GB VRAM. I expect that it could run 7b models easily. linkfedilink
How about a Zotac zbox? ZBOX QRP7N3500
Max supported memory is 64GB and it has an RTX3050 with 12GB VRAM. I expect that it could run 7b models easily.