luncheroo@alien.topOPBtoLocalLLaMA@poweruser.forum•Oh We Were So Close, Little 7b BuddyEnglish
1·
1 year agoI’m sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.
I’m sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.
Just a quick note for anyone using LM Studio who doesn’t want to fiddle too much–the Codellama OpenAssistant preset works fine without ask/answer loops.
I’m going to petition Huggingface to add it.