SatoshiReport@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoAPI to a service that offers access to open source LLMs?message-squaremessage-square4fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareAPI to a service that offers access to open source LLMs?SatoshiReport@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square4fedilinkfile-text
minus-squareemotion_something@alien.topBlinkfedilinkEnglisharrow-up1·1 year agohttps://skymel.com/ . We are in closed beta and provide javascript library ( along with api endpoint) that decides in real time whether to run inference locally on the device or call api . You only pay for the api calls or gpu minutes used.
https://skymel.com/ . We are in closed beta and provide javascript library ( along with api endpoint) that decides in real time whether to run inference locally on the device or call api . You only pay for the api calls or gpu minutes used.