minus-squareDaltonSC2@alien.topBtoLocalLLaMA@poweruser.forum•What is the tiniest GPT model one can fine tune on home hardware?linkfedilinkEnglisharrow-up1·1 year agoCheckout NanoGPT, it’s very educational. You can even load GPT2 weights and finetune them if you want: https://github.com/karpathy/nanoGPT (The accompanying YouTube video is also very nice) linkfedilink
Checkout NanoGPT, it’s very educational. You can even load GPT2 weights and finetune them if you want: https://github.com/karpathy/nanoGPT (The accompanying YouTube video is also very nice)