rarted_tarp@alien.topBtoLocalLLaMA@poweruser.forum•New APU’s close to Gpu processing, but with unlimited memory?English
1·
11 months agoThe UMA has a lot more to do with the speed than distance, and GPU has a much different architecture and memory access patterns than a CPU.
It might help for LLMs since a lot of values are cached after each loop, but still highly unlikely to make a difference.