I like following the open source LLM scene, but I’m going to keep using ChatGPT plus since its still much better than other LLMs out there. This is the only subscription I can justify paying for and consistently get my $$ worth out of (though I am a broke college student). The only way I’d stop is if running paid close sourced models weren’t any better or if open LLMs were better, or at the very least they weren’t much better to justify paying. Open ones have the advantages of privacy, offline usage, and for some of them: less or no censorship.
I have a shitty ass old macbook air so I’ve messed with some open-source stuff on Colab, but otherwise feel pretty limited. If I wasn’t so busy at work I’d probably spring for some cloud computer but am too stingy.
As a software dev with a really locked down work laptop, almost exclusively gpt4. It’s just better than open source models and since the firewall is pretty restrictive, it’s the only convenient way to access a good llm.
Unless I have a python script idea I’m using open source. too many bugs in the scripts so doing it locally is just a pain in the ass.