So real quick, I’ve been exploring local LLM for a bit and so on. In this video I get into what I think is the future for LLM, but in a nut shell I think Microsoft will eventually push out a local LLM to machines to cut down on a lot of resources and cost. In doing so, it likely will be possible for developers to tap into that local LLM for their game.
The worries I seen bring up is
- Spoilers - As mention in the video it is currently and it should always be possible to solve for this in the stuff sent to the LLM. The LLM can’t talk about what it doesn’t know.
- The NPC talks about stuff it shouldn’t - by fine tuning it, this solves this problem to an extreme degree. The better you prep it, the less likely it will go off script. Even more with how you coded your end.
- Story lines shouldn’t be dynamic. The answer to this is simple. Don’t use the LLM for those lines and given NPC.
- Cost - Assuming I’m right about Microsoft and others will add a local LLM. The local part of it removes this problem.
https://www.youtube.com/watch?v=N31x4qHBsNM
It is possible to have it where given NPC show different emotions and direct their emotions as shown here where I tested it with anger.
https://www.youtube.com/shorts/5mPjOLT7H-Q
I think this would play well with some games.
Might need to go back to dual graphics cards setups, one for finetuned LLMs and one for the actual game.
But imagine a civilization 7 with LLM based AI.
Can’t imagine the batshit stuff that would come out of that and high replayability. It would even pair well with the more limited context (we don’t really need catherine the great to hold a grudge from 3000bc in 1800ad).
I could see secret alliances, clandestine plans to take over the world, strange treaties… the world congress could be a lot more fun/interactive…
Why did Gandhi team up with Sulaiman to launch a first strike nuclear attack on me??? What does he mean the burning flesh of my people is more satisfying than the scent of fresh rose water???