microsoft/OmniParser
View on GitHub ↗ ★ 25,612 Jupyter Notebook
A simple screen parsing tool towards pure vision based GUI agent
7 mentions on Hacker News by 6 people: 2 stories, 5 comments · first 2024-10-26 · latest 2025-12-03
20082026
-
…too. https://huggingface.co/allenai/Molmo-7B-D-0924 https://github.com/logankeenan/george https://github.com/microsoft/OmniParser
comment by logankeenan · 2025-12-03 · in Qwen3-VL can scan two-hour videos and pinpoint nearly every detail -
…I think Omni parser from Microsoft would also work well. https://github.com/logankeenan/george https://github.com/microsoft/OmniParser
comment by logankeenan · 2025-05-13 · in FastVLM: Efficient vision encoding for vision language models -
▲ 2
OmniTool – Control a Windows 11 VM with OmniParser plus vision model of choicestory by danboarder · 2025-02-21 · 0 comments
-
https://github.com/microsoft/OmniParser/ is trending on Github
comment by abrichr · 2025-02-20 · in You can’t build a moat with AI (redux) -
▲ 64
OmniParser V2 – A simple screen parsing tool towards pure vision based GUI agentstory by punnerud · 2025-02-15 · 4 comments
-
There are dedicated models for recognizing UI elements such as form fields. One example is https://github.com/microsoft/OmniParser
comment by rolisz · 2025-01-14 · in How we used GPT-4o for image detection with 350 similar illustrations -
…it but my understanding is the repo here has got working code along with installation instructions: https://github.com/microsoft/OmniParser
comment by nmstoker · 2024-10-26 · in OmniParser for Pure Vision Based GUI Agent