Don’t buy the v100 at amazon.se - that price is crazy high
Rack servers like the dell r720 are nice platforms for passively cooled Nvidia tesla gps’s if you’re into ai/ml…
Nous capybara yi-34 q6 gguf works very well for complex summarization (which requires some instruction following) of large texts. Temp=0, repeat penalty =[0.9-1.1]. Prompt: SYSTEM: USER: ASSISTANT:
Yi-34-200k is trained for summarization and does it really well
Thanks! V informative, will keep for reference👍🏼
Yea, the non-tuned (base) or lightly tuned Yi versions that I’ve recently have been in need of fixes…
Check out the gron tool
Some of the other larger china sellers of refurb epycd on enay have very service ad well. One asked on own initiative which mobi the ordered ram should go in and tested before shipping - nice!