minus-squareParanoidMarvin42@alien.topBtoLocalLLaMA@poweruser.forum•Maybe anecdotal but I have very high hopes for Yi 34b finetunes.linkfedilinkEnglisharrow-up1·10 months agoDo you know how to estimate how much memory the context will need? linkfedilink
Do you know how to estimate how much memory the context will need?