From what I’ve read mac somehow uses system ram and windows uses the gpu? It doesn’t make any sense to me. Any help appreciated.

  • ModeradorDoFariaLima@alien.topBEnglish
    1·
    1 year ago

    Imo running any AI on anything other than VRAM makes it so slow it’s unusable. So, you can play around with 13b quantized models.