Hacker GitHub

← All repos

lm-sys/FastChat

View on GitHub ↗ ★ 39,550 Python

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

35 mentions on Hacker News by 30 people: 5 stories, 30 comments · first 2023-03-31 · latest 2024-12-13

Mentions per year 35 mentions · busiest year 2023 (30)
20082026
AllStoriesComments NewestTopOldest
  1. …or whatever.. you might be able to strike up the same kind of dealio that LMSYS has with lmarena - > github.com/lm-sys/FastChat - > lmarena .ai to use the site you have a big obvious popup explaining the data use quickly and efficiently
    comment by downloadram · 2024-12-13 · in Show HN: I made the slowest, most expensive GPT
  2. …will. That is to say, people would happily send it to you. More people should self-host stuff like https://github.com/lm-sys/FastChat without revealing their dataset, I think, and we would probably trust it more than the public stuff,…
    comment by tucnak · 2024-11-13 · in Qwen2.5-Coder-32B is an LLM that can code well that runs on my Mac
  3. …eval scene when people inevitably grow wary of leaderboard-propaganda. More people should host https://github.com/lm-sys/FastChat
    comment by tucnak · 2024-11-13 · in Qwen2.5-Coder-32B is an LLM that can code well that runs on my Mac
  4. …slow, so slow that the arena displays a warning whenever it is chosen as one of the competitors [0] https://github.com/lm-sys/FastChat/issues/2527
    comment by skissane · 2024-04-30 · in GPT-4.5 or GPT-5 being tested on LMSYS?
  5. https://github.com/lm-sys/FastChat/issues/1210
    comment by epups · 2024-01-11 · in ChatGPT for Teams
  6. ▲ 1
    FastChat: An open platform for training and serving large language models
    story by aussieguy1234 · 2023-12-24 · 0 comments
  7. How does it compare with something like FastChat? https://github.com/lm-sys/FastChat Feature set seems like a decent amount of overlap. One limitation of FastChat, as far as I can tell, is that one is limited to the models that FastChat…
    comment by SOLAR_FIELDS · 2023-11-22 · in LM Studio – Discover, download, and run local LLMs
  8. …that would prevent the code being Apache 2.0 based on the source of the fine-tuning dataset? [1] https://github.com/lm-sys/FastChat
    comment by yeldarb · 2023-11-21 · in Video-LLaVA
  9. …little heavier but much more robust in terms of features/functionality I've been enjoying FastChat: https://github.com/lm-sys/FastChat It allows you to plug in different backends so that you can use OpenAI compatible clients with various…
    comment by SOLAR_FIELDS · 2023-10-19 · in Show HN: ChatAPI – PWA to Use ChatGPT by API
  10. ▲ 3
    An open platform for training, serving, and evaluating large language models
    story by udev4096 · 2023-09-13 · 0 comments
  11. …model behind a hosted endpoint -- If you do want to self-host - there's some great libraries like https://github.com/lm-sys/FastChat and https://github.com/ggerganov/llama.cpp that might be helpful If none of these really solve your issue…
    comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching
  12. …which can emulate an OpenAI API using local models. 0: https://github.com/go-skynet/LocalAI 1: https://github.com/lm-sys/FastChat/ Edit: idk if any of this support function calling tho
    comment by pablo1107 · 2023-08-09 · in Show HN: Agentflow – Run Complex LLM Workflows from Simple JSON
  13. …At a glance, it seems like it's going for lots of similar goals (run LLMs with interoperable APIs): https://github.com/lm-sys/FastChat
    comment by phsource · 2023-06-19 · in OpenLLM
  14. https://github.com/lm-sys/FastChat The hardest part is downloading the 30GB of weights.
    comment by amstan · 2023-06-17 · in I’m an ER doctor. Here’s how I’m already using ChatGPT to help treat patients
  15. ▲ 2
    OSS for training, serving, and evaluating LLM based ChatBots
    story by yujian · 2023-06-15 · 0 comments
  16. These days I use FastChat: https://github.com/lm-sys/FastChat It’s not based on llama.cpp but huggingface transformers but can also run on CPU. It works well, can be distributed and very conveniently provide the same REST API than OpenAI…
    comment by speedgoose · 2023-05-14 · in Run Llama 13B with a 6GB graphics card
  17. Did you see https://github.com/lm-sys/FastChat/blob/main/docs/arena.md#h... ?
    comment by mdaniel · 2023-05-11 · in LLMs Leaderboard
  18. Install a local LLM (e.g. Vicuna https://github.com/lm-sys/FastChat ) to have an offline alternative for stackoverflow (and GPT4).
    comment by dsrtslnd23 · 2023-05-10 · in Ask HN: I won't have Internet access for months, How could I use my time?
  19. …grade gaming hardware. The FastChat framework supports the Vicuna LLM, along with several others: https://github.com/lm-sys/FastChat The Oobabooga web interface aims to become the standard interface for chat models:…
    comment by loudmax · 2023-05-03 · in OpenLLaMA: An Open Reproduction of LLaMA
  20. Most people are distributing diff files like this https://github.com/lm-sys/FastChat#vicuna-weights Ie. Here’s a diff. Go find your own copy of the llama model and apply this patch. …and hoping that’s good enough to get away with; even…
    comment by wokwokwok · 2023-04-16 · in Web LLM – WebGPU Powered Inference of Large Language Models
  21. …[0]. They trained on an A100 which costs $10k [1]. [0]: https://vicuna.lmsys.org/ [1]: https://github.com/lm-sys/FastChat/blob/main/scripts/train-v...
    comment by whimsicalism · 2023-04-11 · in The Coming of Local LLMs
  22. This is incorrect. According to the official https://github.com/lm-sys/FastChat#vicuna-weights you need the original Llama weights before applying the Vicuna diff.
    comment by sp332 · 2023-04-09 · in The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
  23. And I think the problem of taking the roles of users in vicuna is caused by this bug: https://github.com/lm-sys/FastChat/commit/1bb234265d16bdfd50... which has been fixed recently. Lmsys are launching new training jobs after this patch,…
    comment by zhisbug · 2023-04-06 · in State-of-the-Art Chatbot, Vicuna-7B, now runs on MacBook with GPU acceleration
  24. The github page ( https://github.com/lm-sys/FastChat#vicuna-weights ) is better: > We release Vicuna weights as delta weights to comply with the LLaMA model license. You can add our delta to the original LLaMA weights to obtain the Vicuna…
    comment by TehCorwiz · 2023-04-05 · in Using mmap to make LLaMA load faster
  25. The weight deltas are available: https://github.com/lm-sys/FastChat#vicuna-weights
    comment by danielbln · 2023-04-05 · in Using mmap to make LLaMA load faster
  26. …includes humans chatting with GPT-4 vs GPT4All's purely synthetic dataset generated by GPT-3.5. [0] https://github.com/lm-sys/FastChat
    comment by MacsHeadroom · 2023-04-04 · in Show HN: Promptr, let GPT operate on your codebase and other useful goodies
  27. Yes, you need to convert the original LLaMA model to the huggingface format, according to https://github.com/lm-sys/FastChat#vicuna-weights and https://huggingface.co/docs/transformers/main/model_doc/llam...
    comment by zhwu · 2023-04-03 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
  28. …it becomes less unlikely. Edit: Also, judging by a comment from the team in the GitHub repository ( https://github.com/lm-sys/FastChat/issues/86#issuecomment-14... ), they seem to at least hint about been in contact with the llama team.
    comment by capableweb · 2023-04-03 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
  29. You can use this command to apply the delta weights. ( https://github.com/lm-sys/FastChat#vicuna-13b ) The delta weights are hosted on huggingface and will be automatically downloaded.
    comment by MMMercy2 · 2023-04-03 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
  30. …in their instruction, the delta will be automatically downloaded and applied to the base model. https://github.com/lm-sys/FastChat#vicuna-13b : `python3 -m fastchat.model.apply_delta --base /path/to/llama-13b --target…
    comment by zhwu · 2023-04-03 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
  31. ▲ 4
    Vicuna: An Open Chatbot Impressing GPT-4
    story by georgehill · 2023-04-03 · 4 comments
  32. ▲ 1
    FastChat a Benchmark for Chat Models
    story by amrb · 2023-04-02 · 0 comments
  33. …Check out detailed CLI instructions and SkyPilot YAMLs here if you want to give it a try: - https://github.com/lm-sys/FastChat#vicuna - https://github.com/lm-sys/FastChat/blob/main/scripts/train-v...
    comment by covi · 2023-03-31 · in Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality
  34. …and as best I can tell that's what the yaml files in their repo are for: https://github.com/lm-sys/FastChat/blob/main/scripts/train-v...
    comment by mdaniel · 2023-03-31 · in Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality
  35. …I asked it what license Vicuna was released under and it claimed MIT (it's actually Apache 2: https://github.com/lm-sys/FastChat/blob/main/LICENSE ) and when I asked it to tell me why it believed the project was MIT licensed it told me…
    comment by mdaniel · 2023-03-31 · in Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality