minus-squarelxe@alien.topBtoLocalLLaMA@poweruser.forum•ExLlamaV2: The Fastest Library to Run LLMslinkfedilinkEnglisharrow-up1·1 year agoAgreed. Best performance running GPTQ’s. Missing the HF samplers but that’s ok. linkfedilink
minus-squarelxe@alien.topBtoLocalLLaMA@poweruser.forum•When OpenAI takes neutering to the extreme...linkfedilinkarrow-up1·1 year agoSo safe So aligned linkfedilink
minus-squarelxe@alien.topBtoLocalLLaMA@poweruser.forum•Executive order on AI - Now a good time to get my own local?linkfedilinkEnglisharrow-up1·1 year agoIt’s an executive order about AI used by federal government. linkfedilink
Agreed. Best performance running GPTQ’s. Missing the HF samplers but that’s ok.