Currently we manually set the temperature and keep it the whole chat. Wouldnt it make more sense to let the model decide a temperature itself depending on the topic?
Currently we manually set the temperature and keep it the whole chat. Wouldnt it make more sense to let the model decide a temperature itself depending on the topic?
See also:
https://github.com/ggerganov/llama.cpp/issues/3483
https://github.com/kalomaze/koboldcpp/tree/exp-dynatemp-minp-latest