PookaMacPhellimen@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoQwen-72B releasedhuggingface.coexternal-linkmessage-square39fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkQwen-72B releasedhuggingface.coPookaMacPhellimen@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square39fedilink
minus-squarea_beautiful_rhind@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoHeh, 72b with 32k and GQA seems reasonable. Will make for interesting tunes if it’s not super restricted.
Heh, 72b with 32k and GQA seems reasonable. Will make for interesting tunes if it’s not super restricted.