I have tried recent model drops and will still stick to Ti34b-chat, as it is the most creative in terms of creative writing.

Then I attached the RAG approach to the model and fed to the embeddings the entire World War Z .txt book (zombie horrors lover here, guilty).

Here is what the story written with that approach looks like:

https://pastebin.com/4UL68WAm (raw output, no cherry-pick)

1. What do you think about the creativity of the text?
2. Has anyone tried to QLORA the real book, and does it help to “continue” the favorite books?