So far, I have experimented with the following projects:
https://github.com/huggingface/chat-ui - Amazing clean UI with very good web search, my go to currently.
https://github.com/oobabooga/text-generation-webui - Best overall, supports any model format and has many extensions
https://github.com/ParisNeo/lollms-webui/ - Has PDF, stable diffusion and web search integration
https://github.com/h2oai/h2ogpt - Has PDF, Web search, best for files ingestion (supports many file formats)
https://github.com/SillyTavern/SillyTavern - Best for custom characters and roleplay
https://github.com/NimbleBoxAI/ChainFury - Has great UI and web search (experimental)
https://github.com/nomic-ai/gpt4all - Basic UI that replicated ChatGPT
https://github.com/imartinez/privateGPT - Basic UI that replicated ChatGPT with PDF integration
LM Studio - Clean UI, focuses on GGUF format
-
Really love them and wondering if there are any other great projects,
Some of them include full web search and PDF integrations, some are more about characters, or for example oobabooga is the best at trying every single model format there is as it supports anything.
What is your favorite project to interact with your large language models ?
Share your findings and il add them!
exui by turboderp (exllamav2 creator) is a nice ui for exl2 models. https://github.com/turboderp/exui
Can it serve on a CPU-only machine?
I wish we had a UI like this for GGUF (for Apple)