Does anyone have any recommendations on an api service that provides access to open source LLMs?

  • emotion_something@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    https://skymel.com/ . We are in closed beta and provide javascript library ( along with api endpoint) that decides in real time whether to run inference locally on the device or call api . You only pay for the api calls or gpu minutes used.