Do you know about LoRA?

Almost happened (straight merge with 34b size). The result is good. https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K-DARE-Ties

Frustratingly, we don’t have any good plugins for this on oobabooga. The authors seem to have been scared off by fast API changes.

32k seems to be hard coded in oobabooga. At least it is for truncate length max. There’s a patch to be made to fix it.

Don’t touch the truncate length setting in the UI or it’ll be stuck at 32k until resetting the server.

Treated like an interview for a new employee it’s amazing. What a clear indication would be systems are artificial intelligences and entities in their own independent right.