minus-squareinteresting-_o_-@alien.topBtoMachine Learning@academy.garden•Bill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N]linkfedilinkEnglisharrow-up1·10 months agoCould you please share a citation for the mentioned research papers? Last I looked into this, the hypothesis was that increasing parameter account results in a predictable increase in capability as long as training is correctly adapted. https://arxiv.org/pdf/2206.07682.pdf Very interested to see how these larger models that have plateaued are being trained! linkfedilink
Could you please share a citation for the mentioned research papers?
Last I looked into this, the hypothesis was that increasing parameter account results in a predictable increase in capability as long as training is correctly adapted.
https://arxiv.org/pdf/2206.07682.pdf
Very interested to see how these larger models that have plateaued are being trained!