minus-squareAstronomer3007@alien.topBtoLocalLLaMA@poweruser.forum•New APU’s close to Gpu processing, but with unlimited memory?linkfedilinkEnglisharrow-up1·11 months ago4 channel ddr5 above 6400mhz should get 200 gb/s bandwidth. I wonder how many token/s that setup would get on 34B and 70B models. linkfedilink
4 channel ddr5 above 6400mhz should get 200 gb/s bandwidth. I wonder how many token/s that setup would get on 34B and 70B models.