we_are_mammals@alien.topB to Machine Learning@academy.gardenEnglish · 2 years agoBill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N]www.handelsblatt.comexternal-linkmessage-square130linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkBill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N]www.handelsblatt.comwe_are_mammals@alien.topB to Machine Learning@academy.gardenEnglish · 2 years agomessage-square130linkfedilink
minus-squarered75prime@alien.topBlinkfedilinkEnglisharrow-up1·2 years ago It’s called a scratchpad. And the network still uses skills that it learned in a fixed-computation-per-token regime. Sure, future versions will lift many existing limitations, but I was talking about current LLMs.
And the network still uses skills that it learned in a fixed-computation-per-token regime.
Sure, future versions will lift many existing limitations, but I was talking about current LLMs.