Using Yi-34b Dolphin right now.
Can’t wait to try Qwen 14b and 72b.

• Local AI belongs to you, GPT-4 don’t. You are simply buying permission to use it for a limited time, and AI company can take AI from you anytime they want for any reason they like. You can only lose your local AI if someone physically removes it from your PC and you no longer can download it.
• GPT-4 is censored and biased. Local AI have uncensored options.
• AI companies can monitor, log and use your data for training their AI. With local AI you own your privacy.
• GPT-4 requires internet connection, local AI don’t.
• GPT-4 is subscription based and costs money to use. Local AI is free use.

I think there’s a solution to that; LLM internet access.AI just needs to be smart enough to be able to use tools like a human. Then it can effectively search for the right question and then extract the right answer from the internet.

I’ve been in this ride since the early GPTJ days. I’ve tried A LOT of models. Right now for general use models, preference is refined into only using ChatML format models.

RIP OpenAI.

KoboldCPP because easier to use and packed with a lot of useful features

Sad.

It depends on how random it can be. Making it totally random would be very difficult. Otherwise, your “random” dataset will have some sort of repeating pattern even though certain parameters change randomly. So, your model would learn that pattern and be repetitive.

If I am not mistaken “28M H100 hours” roughly equals to “87M tetryliodo hexamine” or “32M hydrocoptic block rounds” given by the equation P = 2.5 times C times n to the 6th power, minus 7.