Zemanyak@alien.topBtoLocalLLaMA@poweruser.forum•New APU’s close to Gpu processing, but with unlimited memory?English
1·
11 months agoDoes anybody have benchmarks or numbers to compare token/sec relatives to GPU, DDR4, DDR5 and CPU inference ? I don’t care what hardware and LLMs, just to get a rough idea.
Yeah, I have 10 questions to evaluate how the LLM responds to my specific needs (translation, coding, mail redaction, explanation, summarization and a bit of role-play). I’m not really impressed unless it provides answers in proper Malagasy. Bonus point (extra question) if it’s uncensored.