I tried this model a little while ago with LM Studio and I noticed that it does not have GPU acceleration. Sin
What is it for?
I think that the difference in GB from 7 to 13 is mainly due to the capacity of the data stored and able to be queried
do you have to download 71GB to try it?! :-)
when you do serious historical research, time passes so quickly that you don’t even notice. Unfortunately it takes time for the model to give you the information it has stored. However, even with effort I achieved notable results. example the translation of a writing in Runic. something that is difficult today even for specialized people. This is why I say that we need to waste more time making the algorithm understand its purpose. If we limit ourselves to making them just to play it’s a shame . I have tried many, from the most recent to the fastest. lately I’ve been having the best results running utopia-13b.Q4_K_M.gguf which offers me a decent speed, a passionate tone with friendly dialogue and above all decidedly aware in trying to give accurate results
when you do serious historical research, time passes so quickly that you don’t even notice. Unfortunately it takes time for the model to give you the information it has stored. However, even with effort I achieved notable results. example the translation of a writing in Runic. something that is difficult today even for specialized people. This is why I say that we need to waste more time making the algorithm understand its purpose. If we limit ourselves to making them just to play it’s a shame
I tried the model. since I do a lot of historical research I felt like checking it out. I was very disappointed. 1- he answers coldly and succinctly, often getting nervous 2 Even simple answers were 99 per cent wrong. Example I did donande on Hannibal during the Punic war in Spain. the results were demoralising
hello Greetings from Italy. I would like to ask you is there a 7B 0 13 B model that has a good historical data set to study?
what is the difference between normal and 16 K?