I’m looking to build a new PC(which I’ve never done, other than upgrade my current one) for running and fine tuning 7b models. I know I’ll be getting dual 3090 or 4090 GPU, but I’m not sure which CPU would be best for this.

I’m wanting to take advantage of the bundle deals at my local micro center and down to these two options:

  1. AMD Ryzen 9 7900x 4.5ghz 12 core, Asus B650E-F motherboard and 65GB DDR5 for $600
  2. Intel i9 14900k 3.2ghz 24 core, MSI Z790 MAG Tomahawk motherboard and 65gb DDR5 for $800

Anyone know which would be best for my use case? I don’t mind spending the extra $200, I only want the best option of the two

Thanks in advance

  • llama_in_sunglasses@alien.topBEnglish
    1·
    1 year ago

    The lopsided CCUs in X3D parts are not the same as the ones on 7900X/7950X. The cache ensures that you need a scheduler that can put loads that need it on the cache-enabled portion and that’s asking a lot from a scheduler. The AMD parts without extra cache don’t suffer from this issue… it’s why I got a 7950X, but the 7900X is also fine and all three of these CPUs will be entirely limited by memory bandwidth if used for CPU inference.

    • Asleep_Comfortable39@alien.topBEnglish
      1·
      1 year ago

      Information moving between CCU’s is troublesome with certain workloads. I’m not referring to the lopsided cache, but rather the limitations of what is basically two CPUs merged together and the complications that adds to their shared I/O.

      I don’t recommend the 7900x because it is a failed 7950x. I recommend the 7800x3D and the 7950X as long as the prices are within stretching for. The 7950x3D fits a very niche role as well.