minus-squarekitkatmafia@alien.topBtoLocalLLaMA@poweruser.forum•What is the best multi-purpose model available right now?linkfedilinkarrow-up1·1 year agoWizard-lm 13b linkfedilink
kitkatmafia@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoIs anyone using vLLM for inference? Are there any faster inference framework for LLama based models?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareIs anyone using vLLM for inference? Are there any faster inference framework for LLama based models?plus-squarekitkatmafia@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square0fedilink
Wizard-lm 13b