Right now I really only know about and LM Studio for running and using models, I feel like it’s really good and useful but closed source.
Then I saw this (https://www.reddit.com/r/LocalLLaMA/comments/16eoozu/best_software_webgui/) thread here and came to know about so many but didn’t found anyone built with .NET and C#. I am thinking of building one but frankly have no clue of how to start with it.
Does anyone knows about any any open source local LLM GUI built with .NET Framework or help/ guide me in getting started with building one.
If you’re trying to do something novel as part of a learning experiment, just pick a good UI framework and then either wrap LlamaSharp, or interop directly with Llama.cpp using PInvoke.
Personally I just use PInvoke to cut out the middle man
As for a UI framework, I’ve been having a lot of fun with Avalonia lately.
You’re not going to get 100% interop with all models using Llama.cpp as a core but if this is a learning exercise then I’m sure that’s not an issue.
That being said, if you really want to you can fuck around with Python.net but you may find yourself spending way more time trying to manage model interop and execution than you want to.