Does anyone have any recommendations on an api service that provides access to open source LLMs?
You must log in or register to comment.
OpenRouter.ai It’s an openai proxy server that also offer many opensource models.
Replicate
https://skymel.com/ . We are in closed beta and provide javascript library ( along with api endpoint) that decides in real time whether to run inference locally on the device or call api . You only pay for the api calls or gpu minutes used.
NLP Cloud? --> https://nlpcloud.com