I was recently trying to work on a ML project and realized that the I need very specific type of data for what I am trying to achieve which makes me wonder how do people and companies deal with data scarcity, I am pretty sure they at some point need very specific type of data which isn’t easily available
It’s incredibly common. Unfortunately it’s often glossed over or a non ML solution is used but labeled as ML. Recently, sometimwsthere are good solutions available where there is already a foundation model and you can do few-shot learning to calibrate with small data. .