• Healthy_Cry_4861@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    SynthIA-70B-v1.5 seems to have the same context length of 2k as SynthIA-70B-v1.2, not the same 4k context length as SynthIA-70B-v1.2b

    • WolframRavenwolf@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      You’re right with your observation, when I load the GGUF, KoboldCpp says “n_ctx_train: 2048”. Could that be an erroneous display? Because I’ve always used v1.5 with 4K context, did all my tests with that, and it’s done so well. If it’s true, it might even be better with native context! Still, 2K just doesn’t cut it anymore, though.