• 7 Posts
  • 9 Comments
Joined 1 year ago
cake
Cake day: November 25th, 2023

help-circle


  • I want to keep my options open, and potentially have a large context, which can add up to 100GB to memory requirements.

    I’m considering 1x genoa CPU with 12 channels. Something like the 9354 would be more than enough cores. I might start with a cheaper DDR4 machine first though.

    How was it getting the Epyc machine set up? Are you using windows? What about a GPU?