I frequently go through all the LLMs that *The Bloke* posts from time to time. What frustrates me is that there is no information about LLMs specialization. Like is it for **Coding, Roleplaying, Creative Writing etc.**
I then go to original LLM’s place. But it sometime contain no information or drown me with technical details that I don’t understand.

And as for the leader boards, they contain a bunch of numbers, I have to look up each to understand.

My only source is reddit posts and comments here.

Am I missing something ? From the looks of it, it feels like a common knowledge that I missed it some how. I feel like a kid that woke up to a quiz at the end of class after sleeping through it.

  • ttkciar@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I keep thinking of spinning up a website to track/provide this information, but then think “nah, someone else will do it” and focus on other things.

    Usually TheBloke will have a prompt template in the model card, but other parameters need fiddling to figure out.

    When there is no original model card at all, I just skip over the model, and sometimes leave a note for the publishers that they should fill out their model card.

    • hashms0a@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Me too. If I see no prompt template in the model card, I don’t bother to try it. It will not give the best results.