If i have multiple 7b models where each model is trained on one specific topic (e.g. roleplay, math, coding, history, politic…) and i have an interface which decides depending on the context which model to use. Could this outperform bigger models while being faster?
big is an understatement. Please do correct me if I got it wildly wrong, but it appears to be a 3.6TB colossus.