Amazon was building a platform, that now they use as a rentier. Bad for society, good for Amazon.
But LLM models don’t have that. You can swap one out for another with little effort - hell, I do it daily. And with that, it means that you’re a commodity . . . which also means you can’t ever get those initial losses back if your competitor (like Chinese models) doesn’t have them.
Have you seen openrouter.ai? They are more or less based around that idea, I think. Routing to whatever is best fit - most likely on price, I’d think (?) and/or currently up.
I have not set it up myself, but I think there is a way to have opencode or the like prefer local models for certain things, then escalate to something remote (presumably paid) if needed.
Also, opencode.ai gives you so many free tokens per day on some of their models.
Amazon was building a platform, that now they use as a rentier. Bad for society, good for Amazon.
But LLM models don’t have that. You can swap one out for another with little effort - hell, I do it daily. And with that, it means that you’re a commodity . . . which also means you can’t ever get those initial losses back if your competitor (like Chinese models) doesn’t have them.
Have you seen openrouter.ai? They are more or less based around that idea, I think. Routing to whatever is best fit - most likely on price, I’d think (?) and/or currently up.
I have not set it up myself, but I think there is a way to have opencode or the like prefer local models for certain things, then escalate to something remote (presumably paid) if needed.
Also, opencode.ai gives you so many free tokens per day on some of their models.