Exotic-Estimate8355@alien.topBtoLocalLLaMA@poweruser.forum•Why is no one releasing 70b models?English
1·
10 months ago$1/hour for an A100 ? Where? I can barely get one in GCE and it’s almost 4$ / hr
$1/hour for an A100 ? Where? I can barely get one in GCE and it’s almost 4$ / hr
I disagree that go is as simple as python. Don’t stay only with the syntax but also see the stdlib, built ins, etc. Simply making a Fibonacci function with memoization in go is much more complicated in go and requires you to think of more low level unnecessary stuff than python. I’m python you have it in literally four lines of code
Unless it’s some really heavy stuff like learning a new language, you should be fine with LoRA
High temperature + batch inference on the same prompt
Np I’ll quantize to 0.001 bpw