Thistleknot@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoBreak the Sequential Dependency of LLM Inference Using Lookahead Decodingmessage-squaremessage-square4fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareBreak the Sequential Dependency of LLM Inference Using Lookahead DecodingThistleknot@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square4fedilinkfile-text
minus-squareyahma@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoGame changer! Would love to see this incorporated into ExLLama, AutoGPTQ and LlamaCPP
Game changer! Would love to see this incorporated into ExLLama, AutoGPTQ and LlamaCPP