PookaMacPhellimen@alien.topB to LocalLLaMA@poweruser.forumEnglish · 2 years agoQwen-72B releasedhuggingface.coexternal-linkmessage-square39linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkQwen-72B releasedhuggingface.coPookaMacPhellimen@alien.topB to LocalLLaMA@poweruser.forumEnglish · 2 years agomessage-square39linkfedilink
minus-squareASL_Dev@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoTheir own quants for transformers run: https://huggingface.co/Qwen/Qwen-72B-Chat-Int8 https://huggingface.co/Qwen/Qwen-72B-Chat-Int4
Their own quants for transformers run:
https://huggingface.co/Qwen/Qwen-72B-Chat-Int8
https://huggingface.co/Qwen/Qwen-72B-Chat-Int4