CHAT GPT recommends the paper “Rectified Linear Units Improve Restricted Boltzmann Machines” by Vinod Nair and Geoffrey E. Hinton as it is one of the foundational papers introducing and exploring the benefits of ReLUs in neural networks. It also says it is a good starting point to learn about ReLUs and their advantages in machine learning models.

But, from your experience do you have any other papers or textbooks or even videos that you would recommend to someone learning about it? I don’t mind if they’re math heavy, as I do have a Bsc Honours in App Math.

Thanks!