Hi,
A lot of roleplay models I tried like to continue the story with some sappy s*** and I hate it. I tried to tell them not to, but they aren’t listening to me.
For an example:
X does y. What will happen next? Only time will tell…
Together, x and y are unstoppable. It is a testament to the spirit and unyielding hope they have.
Except multiply the amount of garbage by three.
I tried many models and they all seem to do this. I am getting really tired of it as when it starts it’s almost impossible to get it to stop and it just ruins a perfectly good roleplay with this crap…
Sorry for the rant, I’m just a bit frustrated haha.
to remove conditioning try a interface that has classifier free guidance / negative prompt, put the “wholesome nonsense” in the negative prompt and the wanted outcome in the system prompt, make sure they are semantically opposite for best results, check example here for a unhelpfull, toxic assistant: https://github.com/ggerganov/llama.cpp/pull/2135