3 Posts
2 Comments

Joined 1 year ago

Cake day: October 29th, 2023

You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.

OverviewCommentsPosts

Longjumping-Bake-557@alien.topBtoLocalLLaMA@poweruser.forum•X.AI Grok could potentially be open sourced on a 6 month delay from launch
link
fedilink
English
arrow-up
1·
1 year ago
Which is hilarious seeing how he kept joking about “closedai” for a while

link
fedilink

Longjumping-Bake-557@alien.topB to

LocalLLaMA@poweruser.forumEnglish · 1 year ago

Why is no one releasing 70b models?

1

Why is no one releasing 70b models?

Longjumping-Bake-557@alien.topB to

LocalLLaMA@poweruser.forumEnglish · 1 year ago

Longjumping-Bake-557@alien.topB to

LocalLLaMA@poweruser.forumEnglish · 1 year ago

Discrepancy between TheBloke_Orca-2-13B-GPTQ and the original one with the tested logic question

2

1

Discrepancy between TheBloke_Orca-2-13B-GPTQ and the original one with the tested logic question

Longjumping-Bake-557@alien.topB to

LocalLLaMA@poweruser.forumEnglish · 1 year ago

2

Longjumping-Bake-557@alien.topBtoLocalLLaMA@poweruser.forum•NVidia H200 achieves nearly 12,000 tokens/sec on Llama2-13B with TensorRT-LLM
link
fedilink
English
arrow-up
1·
1 year ago
And that’s on a die just slightly bigger than the 4090. Unless they increased the size compared to h100?

link
fedilink

Longjumping-Bake-557@alien.topB to

LocalLLaMA@poweruser.forumEnglish · 1 year ago

SynthIA 70b on a single 3090, 0.17tokens/s

1

1

SynthIA 70b on a single 3090, 0.17tokens/s

Longjumping-Bake-557@alien.topB to

LocalLLaMA@poweruser.forumEnglish · 1 year ago

1