Doormatty@alien.topBtoMachine Learning@academy.garden•[D]Three things I think should get more attention in large language modelsEnglish
1·
1 year agoWhat are the current areas of research with regards to tokenization?
What are the current areas of research with regards to tokenization?
No.
The calculations required to even something simple as ‘2+2’ on a NN are exponentially greater than what’s required to do it directly on the CPU.
Even if a completely new method to use NN’s is found that uses a thousand times fewer cycles than it currently does, it’d still be orders of magnitudes more.