Hi,
A lot of roleplay models I tried like to continue the story with some sappy s*** and I hate it. I tried to tell them not to, but they aren’t listening to me.
For an example:
X does y. What will happen next? Only time will tell…
Together, x and y are unstoppable. It is a testament to the spirit and unyielding hope they have.
Except multiply the amount of garbage by three.
I tried many models and they all seem to do this. I am getting really tired of it as when it starts it’s almost impossible to get it to stop and it just ruins a perfectly good roleplay with this crap…
Sorry for the rant, I’m just a bit frustrated haha.
Wow, you have one of the rare 2060 12 GB models. My best guess would be GGUF version, Try Q4 with maybe 25 layers offset in GPU. Make sure to close any apps, as you are gonna be really close to running out of RAM.
The Exllama2 4BPW (or kinda Q4 equivalent) model requires around 23 GB of VRAM as an reference point.
Hmm, I might consider switching out or 2 sticks of 32. That should make things easier. I usually need to be using about 16 at all times for other things so