lans_throwaway@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoLook ahead decoding offers massive (~1.5x) speedup for inferenceplus-squarelmsys.orgexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkLook ahead decoding offers massive (~1.5x) speedup for inferenceplus-squarelmsys.orglans_throwaway@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square0fedilink
lans_throwaway@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoLook ahead decoding offers massive (~1.5x) speedup for inferenceplus-squarelmsys.orgexternal-linkmessage-square4fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkLook ahead decoding offers massive (~1.5x) speedup for inferenceplus-squarelmsys.orglans_throwaway@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square4fedilink
minus-squarelans_throwaway@alien.topBtoLocalLLaMA@poweruser.forum•Dynamic LoRAs -- Crazy idea?linkfedilinkEnglisharrow-up1·1 year agoIsn’t that just Hypernetwork? It’s been done before, eg. for stable diffusion linkfedilink
Isn’t that just Hypernetwork? It’s been done before, eg. for stable diffusion