I overfitted the Phi 1.5 model on a riddle dataset found here:
https://huggingface.co/datasets/Ermarrero/riddles_v1
I just wanted to see how it behaves and I gotta say the output is interesting since it thinks everything is a riddle and tries to break it down logically.
It’s weird but it is kind of refreshing to see a model overthink it and dig too deep into things. I dunno, what do you guys think?
if you want to play around with the model I can upload it to hugginface.
May I know the LoRA parameters, if you used q/LoRA?
This is hilarious on its own and may serve as a good phase of tuning a small model before feeding it more domain specific data, love it.
The ridle json + sydney actually makes the model far more lucid than normally. I applied it on Mythomax and the answers are really good.
To bad that the last sentence is incorrect. For example, Singapore is the capital of Singapore.
dang, that’s actually very impressive
