minus-squareerelim@alien.topBtoLocalLLaMA@poweruser.forum•are there any Super Tiny LLM models which we can ship within a mobile application?linkfedilinkEnglisharrow-up1·1 year agoIt will be very unfriendly for the user having to have a 1-2GB app that eats RAM and battery like a mobile game, still you won’t get good or quick results. Check on Replicate, runpod or vast.ai for cheap GPU linkfedilink
It will be very unfriendly for the user having to have a 1-2GB app that eats RAM and battery like a mobile game, still you won’t get good or quick results. Check on Replicate, runpod or vast.ai for cheap GPU