Does anyone have a setup that works with a Yi34b model on 12GB vram and 32GB ram? I have tried using GGUF but I always end up with the <s> answer. I’m on Oobabooga and any specific settings to overcome this hurdle with GGUF would be greatly appreciated! I</s>

I’m having a lot of fun with it on the following settings for story writing.
I feel like there is loads of grat potential in min_P, once I get it dialed in!

​

https://preview.redd.it/9in73daoix1c1.png?width=619&amp;format=png&amp;auto=webp&amp;s=3f51101d0a40c02ef46de163a707164d28a68f7f

You should give Elon Musk access to this one and charge him by the word 👍😁