lexected@alien.topB to LocalLLaMA@poweruser.forumEnglish · 2 years agoExponentially Faster Language Modelling: 40-78x Faster Feedforward for NLU thanks to FFFsarxiv.orgexternal-linkmessage-square4linkfedilinkarrow-up11arrow-down10cross-posted to: programming@programming.dev
arrow-up11arrow-down1external-linkExponentially Faster Language Modelling: 40-78x Faster Feedforward for NLU thanks to FFFsarxiv.orglexected@alien.topB to LocalLLaMA@poweruser.forumEnglish · 2 years agomessage-square4linkfedilinkcross-posted to: programming@programming.dev
minus-squarematsu-morak@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoSad part is that we need to train a generative model from scratch to use this one; i.e., we can’t fine-tune current models to use FFF. Hope someone does it soon.
Sad part is that we need to train a generative model from scratch to use this one; i.e., we can’t fine-tune current models to use FFF.
Hope someone does it soon.