Given that we got models like Qwen-14B that seem quite good for their size, I got curious about Chinese LLM research and tried to find some sites and found:
Leaderboards:
https://opencompass.org.cn/leaderboard-llm
https://cevalbenchmark.com/static/leaderboard.html
This one looks like a Chinese huggingface equivalent?
I was randomly checking one of the top models on ceval that did not seem to have any discussion here or have any English information on them, https://huggingface.co/Duxiaoman-DI/XuanYuan-70B , which, according on Google translate is a Llama-2-70B model trained on Chinese financial data, and 8192 length context. I turned it into GGUF Q6_K and tested it and yeah it at least doesn’t obviously suck. Generating text with 7000 tokens of text without any rope tricks still creates coherent text. The model speaks English just fine.
My questions for this subreddit are:
Do you follow developments from China specifically? What sites/people/places do you follow? Can you share? Or other insights?
You must log in or register to comment.
China restricts its LLMs from sexting. I even had to download Eva AI previously, before visiting China
Thank you for that leaderboard, it’s definitely a space to keep track of. I keep hearing that China is the leader in AI so I hope they’ll give a good competition to Silicone Valley.
I’ve only heard of Qwen-7b, but have not tested yet. It seems the 14b version performs well against ChatGPT. I’ll put it on my list of models to test.
Yeah, I’ve been excited for the 34B AquilaChat. I saw TheBloke released it GPTQ and GGUF earlier this week, but it doesn’t work when I try to use it. The same as Falcon-180B, an error with a ’ character when I try to load it in text-web-ui :(