minus-squaresirus20x6@alien.topBtoLocalLLaMA@poweruser.forum•Does Dual EPYC work for LLMs?linkfedilinkEnglisharrow-up1·11 months agoThere is a NUMA aware option in llama.cpp linkfedilink
There is a NUMA aware option in llama.cpp