microsoft/SoM
View on GitHub ↗ ★ 1,572 Python
[arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs
4 mentions on Hacker News by 4 people: 1 story, 3 comments · first 2023-11-09 · latest 2024-07-10
20082026
-
…better when words are present in the grid for "Task 6: Counting the rows and columns of a grid" 0: https://github.com/microsoft/SoM
comment by JeremyHerrman · 2024-07-10 · in Vision language models are blind -
…offline models). For better visual understanding, we use a custom fork of Set-of-Mark prompting ( https://github.com/microsoft/SoM ) deployed to EC2 (see https://github.com/OpenAdaptAI/SoM/pull/3 ).
comment by abrichr · 2024-02-06 · in Ask HN: What have you built with LLMs? -
Here are other related links: code: https://github.com/microsoft/SoM demo: https://user-images.githubusercontent.com/3894247/281586831-...
comment by jwyang · 2023-11-09 · in Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vision