With the advent of LLMs, multimodality and “general purpose” AIs which seat on unimaginable amounts money, computing power and data. I’m graduating and want to start a PHD, but feel quite disheartened given the huge results obtained simply by “brute-forcing” and by the ever-growing hype in machine learning that could result in a bubble of data scientists, ML researchers and so on.
I come from a chemistry standpoint. Sometimes the data set is so small it doesn’t matter how big of a model you throw at it. It’s not gonna work. Instead you need to get creative. Employing techniques such as active learning or delta ML. I think that’s still very much in infancy as a field. I’m still an undergrad tho so I might be wrong.