so I got this shiny new GPU and I want to push it to the limit. What’s the most powerful, smartest model out there? Ideally something with as much long-term memory as possible. I’m coming off of ChatGPT 4 and want something local and uncensored
so I got this shiny new GPU and I want to push it to the limit. What’s the most powerful, smartest model out there? Ideally something with as much long-term memory as possible. I’m coming off of ChatGPT 4 and want something local and uncensored
I’m also mucking about with A6000’s. 120b models quantised to 3bpw fit well with a 4K context in 48gb and are a lot of fun. Of course, soon you’ll realise how much more you can do with 2 a6000s…
What’s your favorite model that you’ve been using?