So the system is a gaming laptop which might explain things. The CPU has liquid metal for cooling and a lower TDP so it’s fine. Whereas the GPU has a higher TGP and if ran hard draws like 120W. If the GPU fans are not already on this quickly overwhelming the GPU thermally.
Weird. If I was going to saturate my GPU, I’d pick an intensive game. Seems odd that a gaming laptop might get overwhelmed and shut off if a game is too intensive? Or is is something special about LLMs that make it the Archilles’ heel?
I’m not the type to run super intensive games, and even those games have plenty of warm up time in the form of a loading screen.
That being said, I have had instances of my entire system shutting down due to a graphically intensive game, but it’s much rarer than when running a local LLM.
So the system is a gaming laptop which might explain things. The CPU has liquid metal for cooling and a lower TDP so it’s fine. Whereas the GPU has a higher TGP and if ran hard draws like 120W. If the GPU fans are not already on this quickly overwhelming the GPU thermally.
Weird. If I was going to saturate my GPU, I’d pick an intensive game. Seems odd that a gaming laptop might get overwhelmed and shut off if a game is too intensive? Or is is something special about LLMs that make it the Archilles’ heel?
I’m not the type to run super intensive games, and even those games have plenty of warm up time in the form of a loading screen.
That being said, I have had instances of my entire system shutting down due to a graphically intensive game, but it’s much rarer than when running a local LLM.