So far, I have experimented with the following projects:

https://github.com/huggingface/chat-ui - Amazing clean UI with very good web search, my go to currently.

https://github.com/oobabooga/text-generation-webui - Best overall, supports any model format and has many extensions

https://github.com/ParisNeo/lollms-webui/ - Has PDF, stable diffusion and web search integration

https://github.com/h2oai/h2ogpt - Has PDF, Web search, best for files ingestion (supports many file formats)

https://github.com/SillyTavern/SillyTavern - Best for custom characters and roleplay

https://github.com/NimbleBoxAI/ChainFury - Has great UI and web search (experimental)

https://github.com/nomic-ai/gpt4all - Basic UI that replicated ChatGPT

https://github.com/imartinez/privateGPT - Basic UI that replicated ChatGPT with PDF integration

LM Studio - Clean UI, focuses on GGUF format

-

Really love them and wondering if there are any other great projects,

Some of them include full web search and PDF integrations, some are more about characters, or for example oobabooga is the best at trying every single model format there is as it supports anything.

What is your favorite project to interact with your large language models ?

Share your findings and il add them!

  • Temsirolimus555@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Websearch is dope. Too bad for me because I am comfortable with pip, not npm. Setting this up will involve pulling some hair out, so I will not even attempt.

    I have decent results with langchain and SERP API for google search with gpt 4 function calling. However, I would LOVE the implementation of ChatUI search functionality in python. I hope someone makes a wrapper (if thats even a thing - I am not a programmer by profession).

    • iChrist@alien.topOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Im not great at troubleshooting errors but the install of chat-ui was pretty straightforward.

      If you already have a llamacpp server it would be very easy to connect.

      I enjoy the search functionality so much and I think its worth the hassle, if you need any help with it just comment here.