Hey everyone,
I made a translation Discord bot for around 30,000 servers, but using paid services like Google Translate or DeepL is too expensive. Instead, I’ve switched to an open-source translation model (currently using m2m100 with 400 million parameters) on a CPU. However, the translations it provides aren’t up to par, and I’ve found that newer models like MADLAD-400 deliver much better results. The catch is that MADLAD-400 is too large to run on a CPU.
I’m looking to deploy this improved model on a GPU, but my budget is a bit tight—around $100-150 per month. Does anyone know of any services or offers that provide GPU access within this price range? Any suggestions or recommendations would be greatly appreciated!
vast.ai if you get lucky with reserving a good instance