ninjasaid13@alien.topB to LocalLLaMA@poweruser.forumEnglish · 10 months agoLQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuningarxiv.orgexternal-linkmessage-square2fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkLQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuningarxiv.orgninjasaid13@alien.topB to LocalLLaMA@poweruser.forumEnglish · 10 months agomessage-square2fedilink
minus-squarenested_dreams@alien.topBlinkfedilinkEnglisharrow-up1·10 months agoAlright, these numbers are kinda wild. u/The-Bloke got any spare compute to quant an LQ Nous-Cappy70B or Goliath-120B?
Alright, these numbers are kinda wild. u/The-Bloke got any spare compute to quant an LQ Nous-Cappy70B or Goliath-120B?