AnOnlineHandle@alien.topBtoLocalLLaMA@poweruser.forum•Why are you running local models? What are you doing with them?English
1·
1 year agoI’ve tried training LoRas on my own writing with mixed success.
I’ve tried training LoRas on my own writing with mixed success.
What sort of vram is needed to run a 4bit 70B model?