It sounds rather like it trained on chatGPT output and they didn’t curate it enough to delete those “As a large language model trained by openAI…” category statements.
It’s kinda like Shutterstock watermarks showing up in image generation.
Absolutely! I wanted to start a thread like this myself. There is information out there for general AI stuff. But I seek concrete tutorials and articles about current open source LLMs practice . I agree that knowledge is frustratingly scattered.
Yeah… I thought I’ll be at least “in the room “ buying my setup last year, but it turns out I’m outside in the gutter 🫣😢
What are the top 3 best open source LLMs in your opinion?
Or if you are just playing around, you just write/search for a post on reddit (or various LLM related discords) asking for best model for your task :D
I made this post as an attempt to collect best practices and ideas.
use GPT4 to evaluate output of llama.
That’s always a good option probably but I try to avoid using openAI all together.
Thank you. What does " at 5_K_M" mean ?
Can I use the text web UI with Llama.cpp as model loader or is this too much overhead for ?
Best experience I had was with TheBloke/Wizard-Vicuna-30B- Uncensored-GGML
Best 30B llm so far in general. Censorship kill’s capabilities
Clever. I often run SD and textUI in --listen mode than use it on my IPad.
Yes, I understood you. My claim differs in that I think they DIRECTLY used a lot of GPT4 output through the api, which is very probable because a lot of LLM training is done that way. You ask GPT4 to generate examples of conversations with properties you want your LLM to learn and then train on that.
In order for self identification, as GPT I don’t think that randomly crawled chat Examples from the Internet would be enough.
I am not trying to make a strong claim on that, it’s just a thought. My people both.