From what I’ve read mac somehow uses system ram and windows uses the gpu? It doesn’t make any sense to me. Any help appreciated.

  • Fluboxer@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    7b and 13b fully in vram. 7b models have 35, 13b have 43 layers iirc

    70b involving ram