tvetus@alien.topBtoLocalLLaMA@poweruser.forum•I am going to buy H100s. There are too many options.English
1·
1 year agoCan be hard to rent if all the capacity is bought out. But if it’s just 1 DGX then they might be better off renting.
Can be hard to rent if all the capacity is bought out. But if it’s just 1 DGX then they might be better off renting.
Full precision is not as useful as you think. Even at 4bit, the losses are not that large.
What is your motivation for such large models? You’re sacrificing a lot of speed for the larger model.