alchemist1e9@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoExLlamaV2: The Fastest Library to Run LLMstowardsdatascience.comexternal-linkmessage-square22fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1external-linkExLlamaV2: The Fastest Library to Run LLMstowardsdatascience.comalchemist1e9@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square22fedilinkfile-text
minus-squarebeezbos_trip@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoDoes it run on Apple Silicon?
minus-squareintellidumb@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoBased on the releases, doesn’t look like it. https://github.com/turboderp/exllamav2/releases
Does it run on Apple Silicon?
Based on the releases, doesn’t look like it. https://github.com/turboderp/exllamav2/releases