we_are_mammals@alien.topB to Machine Learning@academy.gardenEnglish · 2 years agoBill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N]www.handelsblatt.comexternal-linkmessage-square130linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkBill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N]www.handelsblatt.comwe_are_mammals@alien.topB to Machine Learning@academy.gardenEnglish · 2 years agomessage-square130linkfedilink
minus-squareliongalahad@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoI don’t think Bill is right on this one, LLM may have achieved a plateau on performance with current architecture, but research is all about optimisation and efficiency, not mere parameter increase. Here’s a good example: https://venturebeat.com/ai/new-technique-can-accelerate-language-models-by-300x/ Remember GPT 5 is still at least 2-3 years away. Plenty of time.
I don’t think Bill is right on this one, LLM may have achieved a plateau on performance with current architecture, but research is all about optimisation and efficiency, not mere parameter increase. Here’s a good example:
https://venturebeat.com/ai/new-technique-can-accelerate-language-models-by-300x/
Remember GPT 5 is still at least 2-3 years away. Plenty of time.