minus-squareemotion_something@alien.topBtoLocalLLaMA@poweruser.forum•API to a service that offers access to open source LLMs?linkfedilinkEnglisharrow-up1·1 year agohttps://skymel.com/ . We are in closed beta and provide javascript library ( along with api endpoint) that decides in real time whether to run inference locally on the device or call api . You only pay for the api calls or gpu minutes used. linkfedilink
emotion_something@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoSeeking Feedback: Integrate LLMs with Just 3 Lines of Code – Pay for Cloud Use Onlyplus-squaremessage-squaremessage-square2fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareSeeking Feedback: Integrate LLMs with Just 3 Lines of Code – Pay for Cloud Use Onlyplus-squareemotion_something@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square2fedilink
https://skymel.com/ . We are in closed beta and provide javascript library ( along with api endpoint) that decides in real time whether to run inference locally on the device or call api . You only pay for the api calls or gpu minutes used.