I think you might be able to plug in another model as a chat agent there. LangChain is pretty flexible, but I do remember being confused about the difference between a chat agent and LLMs. I think you can plug in any of these: https://python.langchain.com/docs/integrations/chat/

I quickly gave up on LangChain and went with custom llama-cpp-python because it was too difficult to figure out what LangChain was doing and customize the behavior.

But I also never got around to conversation memory because my rag prompt alone took 1 minute to start getting a response on my poor little laptop haha

I’m in batch 8 and in the same boat. Just a couple weeks to make the decision haha

Thanks for bringing this up. I have a 1080p portable monitor (and it was expensive because it’s a Sidetrak Swivel that attaches to the back of the laptop).

I was just looking at some reddit posts about scaling for multiple screens, and it sounds pretty shaky in Linux, and more so in KDE. I definitely don’t want to go back to gnome in Linux haha, but apparently I might need to give wayland a try.

Nice! I have a similar enclosure, and I’ve been thinking about building a little multi boot/backup/portable os drive, but wasn’t sure if I could get it all to work together.

I played with ventoy and it’s really convenient for storing isos to boot from, just haven’t tried using the extra space for storage/os.