KeyAdvanced1032@alien.topBtoLocalLLaMA@poweruser.forum•In my opinion open-source projects should focus an a very narrow thing, instead of focusing on being a "GPT", that focuses on being able to do everything.English
1·
1 year agoSmall specialized LLMs are going to be a thing the same way using frameworks is now.
I think all frameworks support custom instruct templates, and know for a fact llama.cpp does due to my use of StudioLM, based on llama.cpp, in which I can alter the system / user / assistant templates.