Currently we manually set the temperature and keep it the whole chat. Wouldnt it make more sense to let the model decide a temperature itself depending on the topic?
Currently we manually set the temperature and keep it the whole chat. Wouldnt it make more sense to let the model decide a temperature itself depending on the topic?
Automatic temperature does work. It goes great with min_P. I like it more than mirostat and hope everything implements it.