Dankmre@alien.topBtoLocalLLaMA@poweruser.forum•Chassis only has space for 1 GPU - Llama 2 70b possible on a budget?English
1·
11 months agoOp seems to want 5-10 T/s on a budget with 70B… Not going to happen I think.
Op seems to want 5-10 T/s on a budget with 70B… Not going to happen I think.
I remain skeptical of intel arc compatibility. It is a good deal but that probably why.
For instance would koboldcpp let me offload to both an intel and nvidia card?
Things move so fast I don’t mind the threads about it.
Meanwhile only like 3 people can even use grok atm