ray-project/llmperf-leaderboard
View on GitHub ↗ ★ 473 archived
6 mentions on Hacker News by 5 people: 2 stories, 4 comments · first 2023-12-21 · latest 2024-04-08
20082026
-
…competitive with any other provider, and lower than most of them. Here's some benchmarks: https://github.com/ray-project/llmperf-leaderboard#70b-model...
comment by LoganDark · 2024-04-08 · in Groq CEO: 'We No Longer Sell Hardware' -
…but on this independent benchmark (LLMPerf) Groq's time to first token is also lowest: https://github.com/ray-project/llmperf-leaderboard?tab=readm...
comment by tome · 2024-02-19 · in Groq runs Mixtral 8x7B-32k with 500 T/s -
Not so sure about that. Check out https://github.com/ray-project/llmperf-leaderboard And try mixtral on chat.groq.com
comment by T_S_ · 2024-01-31 · in Brave Leo now uses Mixtral 8x7B as default -
> independent performance conformations. Groq has just been added to the LLMPerf Leaderboard: https://github.com/ray-project/llmperf-leaderboard#output-to... (Disclosure: I work for Groq)
comment by tome · 2024-01-10 · in Nvidia Unveils RTX 5880 Graphics Card with 14,080 CUDA Cores and 48GB VRAM