So, a couple years ago, i found something called AI dungeon, it was my first contact with an AI model. It was very good until it got censored af. The version i used was probably using GPT 2 or 1 (idk)

Is there any model that can compare or is better for text based RPGS that isn’t very censored and preferably 7b (im running on oobagooba with my CPU)

Note: Sorry if i used the wrong terminology, I’m still a total noob lol. I discovered you can run your own language model just 2 days ago, and don’t worry, I’m not trying to fulfill some weird fetish 💀.

  • rainbowkarin@alien.topBEnglish
    1·
    10 months ago

    u/MostlyRocketScience has some good recommendations (I myself had a lot of fun asking OpenHermes 2.5 to start text adventures, though it has a habit of going on unless you set the generation length to 200 or lower).

    If you mean recreating AI Dungeon literally, there’s Dan’s Adventurous Winds 7B (based off of the well-received 7B “Mistral” models), which has been trained on text adventure datasets.

    There’s also these which were trained on the original AI Dungeon dataset (which was pretty unhinged), but they aren’t the same size you’re looking for:

    • AI Dungeon 2 Classic (1.5B, the original GPT-2 model; to run it under Oobabooga you need to use the “ctransformers” loader)

    • Spring Dragon (13B, intended to replicate AI Dungeon’s paid GPT-3 model from 2020)