Outrageous-Drama924@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoWhat is the best 7B model for reading comprehension and instruction following at the moment?message-squaremessage-square9fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareWhat is the best 7B model for reading comprehension and instruction following at the moment?Outrageous-Drama924@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square9fedilinkfile-text
minus-squaremdutAi@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoIn my opinion, the “zephyr 7b beta” model is the best among the 7b models in terms of humane behaviors and reading comprehension. The disadvantage of this model is coding and mathematics. Here is the information screen https://cdn-uploads.huggingface.co/production/uploads/6200d0a443eb0913fa2df7cc/raxvt5ma16d7T23my34WC.png Also, if you would like to examine the model: https://huggingface.co/HuggingFaceH4/zephyr-7b-beta I can run it with Langchain on a laptop with RTX2060 6gb Ram and i7 11h and 32 ram. The secret is INT4
In my opinion, the “zephyr 7b beta” model is the best among the 7b models in terms of humane behaviors and reading comprehension. The disadvantage of this model is coding and mathematics. Here is the information screen
https://cdn-uploads.huggingface.co/production/uploads/6200d0a443eb0913fa2df7cc/raxvt5ma16d7T23my34WC.png
Also, if you would like to examine the model:
https://huggingface.co/HuggingFaceH4/zephyr-7b-beta
I can run it with Langchain on a laptop with RTX2060 6gb Ram and i7 11h and 32 ram.
The secret is INT4