vlodia@alien.topBtoLocalLLaMA@poweruser.forum•Macs with 32GB of memory can run 70B models with the GPU.English
1·
10 months agohow about for those mere mortals with an entry level Macbook Pro M1 Pro 2022? Share a link to a friend?
how about for those mere mortals with an entry level Macbook Pro M1 Pro 2022? Share a link to a friend?
How many tokens is its limit? And how do you change its token parameters in python?