Training_Wait_3904@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year ago8x P40/P100 (PCIE) serversmessage-squaremessage-square4fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-square8x P40/P100 (PCIE) serversTraining_Wait_3904@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square4fedilinkfile-text
minus-squarea_beautiful_rhind@alien.topBlinkfedilinkEnglisharrow-up1·1 year ago3090s are faster. P40s are mostly stuck with GGUF. P100s are decent for FP16 ops but you will need twice as many. All depends on what you want to do. 8 cards are going to use a lot of electricity and make a lot of noise.
3090s are faster. P40s are mostly stuck with GGUF. P100s are decent for FP16 ops but you will need twice as many.
All depends on what you want to do. 8 cards are going to use a lot of electricity and make a lot of noise.