Hacker GitHub

← All repos

haotian-liu/LLaVA

View on GitHub ↗ ★ 25,080 Python

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

13 mentions on Hacker News by 12 people: 2 stories, 11 comments · first 2023-04-18 · latest 2025-08-06

Mentions per year 13 mentions · busiest year 2023 (10)
20082026
AllStoriesComments NewestTopOldest
  1. No, anyone can do it: https://github.com/haotian-liu/LLaVA
    comment by BoorishBears · 2025-08-06 · in Open models by OpenAI
  2. …[3] - https://huggingface.co/microsoft/Phi-3-vision-128k-instruct [4] - https://github.com/haotian-liu/LLaVA [5] - https://github.com/OpenBMB/MiniCPM-V
    comment by daemonologist · 2024-08-09 · in Show HN: LLM-aided OCR – Correcting Tesseract OCR errors with LLMs
  3. …different ones have cropped up. Right now you'll have to read papers to get the training recipes. - https://github.com/haotian-liu/LLaVA/blob/main/scripts/finet... - https://github.com/InternLM/xtuner/tree/main -…
    comment by llama_person · 2024-05-15 · in PaliGemma: Open-Source Multimodal Model by Google
  4. …use question on LLaVA - it is licensed under Apache 2.0. Can be used commercially with attribution: https://github.com/haotian-liu/LLaVA/blob/main/LICENSE
    comment by sheepscreek · 2023-12-11 · in Show HN: I Remade the Fake Google Gemini Demo, Except Using GPT-4 and It's Real
  5. …I’d even encourage anyone who cares about vision or multi-modality to give LLaVA a serious shot ( https://github.com/haotian-liu/LLaVA ). I have been playing with the 7B q5_k variant last couple of days and I am seriously impressed with…
    comment by sheepscreek · 2023-12-11 · in Show HN: I Remade the Fake Google Gemini Demo, Except Using GPT-4 and It's Real
  6. …which might do better, though there's no chance it will be anywhere near as good as GPT-4 Vision. https://github.com/haotian-liu/LLaVA/blob/main/docs/MODEL_ZO...
    comment by simonw · 2023-11-30 · in Llamafile lets you distribute and run LLMs with a single file
  7. There are open source models such as https://github.com/THUDM/CogVLM and https://github.com/haotian-liu/LLaVA .
    comment by supriyo-biswas · 2023-11-09 · in Using GPT-4 Vision with Vimium to browse the web
  8. …but the license on the pre-trained model is a complete non-starter for almost anything. [0]: https://github.com/haotian-liu/LLaVA [1]: https://huggingface.co/blog/idefics [2]: https://huggingface.co/HuggingFaceM4/idefics-80b-instruct [3]:…
    comment by coder543 · 2023-10-19 · in Fuyu-8B: A multimodal architecture for AI agents
  9. …surreal to me, like trying to train an LLM with the outputs of a worse performing smaller LLM. [0] https://github.com/haotian-liu/LLaVA/blob/main/docs/Data.md#...
    comment by Jackson__ · 2023-10-19 · in Fuyu-8B: A multimodal architecture for AI agents
  10. …is scaled down (max 448x224) and only uses <= 512 tokens. 14x14 pixels is one input token. [1] https://github.com/haotian-liu/LLaVA/blob/ee175feb646f4673fe...
    comment by jxy · 2023-04-19 · in LLaVA: Large Language and Vision Assistant
  11. …Face: https://huggingface.co/liuhaotian/LLaVA-13b-delta-v0 More technical details on the GitHub: https://github.com/haotian-liu/LLaVA
    comment by MacsHeadroom · 2023-04-18 · in LLaVA: Large Language and Vision Assistant