1. for coding
  2. for generating stories, writing email, poems etc.
  3. good overall
  4. etc.
  • Mbando@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    We’ve been fine-tuning models for specific applications like RAG and structured data extraction. Falcon – 7B has been really good for training. It’s both shifting to understand the target domains use of language from the training data, but also picking up instructions really well. Going to try mistral-7B soon for a comparison.

    • ___defn@alien.top
      cake
      B
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Same here. Switched to Mistral a few weeks ago. The results will blow you away, the difference is remarkable.