Additional-Box-6814@alien.topBtoLocalLLaMA@poweruser.forum•Where and how to run Goliath 120b GGUF with good performance?English
1·
1 year agoI use It through openrouterai, around 200k t/$
I use It through openrouterai, around 200k t/$
Hi, recently I’ve been testing several models from openrouterai, and I’ve to say that, so far golliath 120B is the best non-GPT LLM I’ve the opportunitty to play with. I would say that, indulging some issues when using It, It seems close to GPT3. Of course, I’ve not been doing in-depth assesments, my opinion is from the perspective of a generative ai curious user.
So dude, congratulations for your work.
By the way, how many time takes to train a model like this with your machine? 5500$ is soo cheap in contrast i though It could be.
It’s like the fucking goguetta of the LLMs 🤣