Thank you kindly for the response.
a few days on ~24x A100-80G/H100s
I looked at some pricing and did some two handed 10 finger math and estimated it at 12-15 grand?
10x H100s for a few weeks
again, just looking at some retail cloud GPU renters, 20-25 grand?
I’m sure you have better things to do with your time so without doing too much on your end, how far off am I on these guesses?
I’m just a lowly end user and spectator, can someone ballpark how much it’d cost to shear Goliath-120B to 70B so I can wake up and sip my coffee then spray it on my monitor and say “good lord that’s rather expensive!”
Also, how much for a 7B to 1.3B? and has it been done before? How bad is the drop in quality? I mean older 7B models are not so great to began with so the idea of seeing Mistral-7B downsized to 1.3B would be kind of fun and definitely something I want to play with.
Same, even the model from the bloke that was released hours ago wouldn’t work :-(