Has anyone of you tried any low to mid tier LLMs that run smoothly on the 4060 TI? Any thoughts?
You must log in or register to comment.
Yes, of course. I’m running them on a 4070Ti with only 12Gb of RAM - sometimes I have to accept slower speeds, but I can still run more or less anything I might reasonably want to (and a few things that are distinctly UNreasonable).