zai-org/CogVLM
View on GitHub ↗ ★ 6,747 Python
a state-of-the-art-level open visual language model | 多模态预训练模型
14 mentions on Hacker News by 10 people: 3 stories, 11 comments · first 2023-10-16 · latest 2024-04-09
20082026
-
…and had found CogAgent[0] that looks quite interesting, has anyone tried anything similar? 0. https://github.com/THUDM/CogVLM?tab=readme-ov-file#gui-agent...
comment by namanyayg · 2024-04-09 · in ScreenAI: A visual LLM for UI and visually-situated language understanding -
…Language Models CogAgent: A Visual Language Model for GUI Agents https://arxiv.org/abs/2312.08914 https://github.com/THUDM/CogVLM https://arxiv.org/pdf/2312.08914.pdf CogAgent: A Visual Language Model for GUI Agents Abstract People are…
comment by DonHopkins · 2024-02-17 · in UFO: A UI-Focused AI Agent for Windows OS Interaction -
CogVLM is very good in my (brief) testing: https://github.com/THUDM/CogVLM The model weights seem to be under a non-commercial license, not true open source, but it is "open access" as you requested. It would be nice if someone trained a…
comment by coder543 · 2024-01-09 · in Mixtral 8x7B: A sparse Mixture of Experts language model -
…it easier than ever to bypass those systems. CogVLM is just sitting there menacingly on github https://github.com/THUDM/CogVLM
comment by abledon · 2024-01-09 · in IT employment grew by just 700 jobs in 2023 -
for image analysis there are these two options: https://www.adept.ai/blog/fuyu-8b https://github.com/THUDM/CogVLM
comment by em-bee · 2023-12-21 · in Show HN: I built an open source AI video search engine to learn more about AI -
Jump to heading for benchmarks and examples: https://github.com/THUDM/CogVLM/tree/main?tab=readme-ov-file...
comment by stevenhuang · 2023-12-17 · in CogAgent-18B – visual-based GUI Agent capabilities -
+1 on CogVLM. https://github.com/THUDM/CogVLM Recent discussions: https://github.com/ggerganov/llama.cpp/discussions/4350 It is the best open source vision language model out there that I'm aware of that's most comparable to gpt4v. Beats…
comment by stevenhuang · 2023-12-11 · in The industries AI is disrupting are not lucrative -
Looks amazing. Non-commercial license. CogVLM does allow commercial. https://github.com/THUDM/CogVLM
comment by ilaksh · 2023-11-13 · in LLaVA-Plus: Large Language, Vision Assistants That Plug and Learn to Use Skills -
There are open source models such as https://github.com/THUDM/CogVLM and https://github.com/haotian-liu/LLaVA .
comment by supriyo-biswas · 2023-11-09 · in Using GPT-4 Vision with Vimium to browse the web -
…[2]: https://huggingface.co/HuggingFaceM4/idefics-80b-instruct [3]: https://github.com/THUDM/CogVLM [4]: https://github.com/Vision-CAIR/MiniGPT-4
comment by coder543 · 2023-10-19 · in Fuyu-8B: A multimodal architecture for AI agents