Simple question, is it worth stopping using Chatgpt (not plus) in order to use a local version of a LLAMA with my current GC ?
Simple question, is it worth stopping using Chatgpt (not plus) in order to use a local version of a LLAMA with my current GC ?
That depends on your usecase. If only need ChatGPT to do school/office work, then even ChatGPT 3 is way better than even llama 70B. If you run into limitations and get warnings all the time, then any uncensored model will greatly improve your experience. You can easily run GPTQ and GGUF Q8 versions of 7B models like Mistral. 13B models are also possible as GPTQ or GGUF Q3_K_M.