getomni-ai/benchmark
View on GitHub ↗ ★ 640 TypeScript
OCR Benchmark
10 mentions on Hacker News by 2 people: 2 stories, 8 comments · first 2025-02-20 · latest 2025-04-01
20082026
-
Yup, they did. The beauty of version control: https://github.com/getomni-ai/benchmark/commit/0544e2a439423...
comment by axpy906 · 2025-04-01 · in Show HN: Qwen-2.5-32B is now the best open source OCR model -
…benchmark runner is fully open source. You can check out the code and reproduction steps here: - https://github.com/getomni-ai/benchmark - https://huggingface.co/datasets/getomni-ai/ocr-benchmark
comment by themanmaran · 2025-03-28 · in Benchmarking open source VLMs for OCR -
…OCR text from Mistral and it scores 70%, that means the inaccuracies are isolated to OCR errors. https://github.com/getomni-ai/benchmark
comment by themanmaran · 2025-03-07 · in Mistral OCR -
…Compared to the other VLMs that are able to interpret those images into a text representation. https://github.com/getomni-ai/benchmark https://huggingface.co/datasets/getomni-ai/ocr-benchmark https://getomni.ai/ocr-benchmark
comment by themanmaran · 2025-03-06 · in Mistral OCR -
…Compared to the other VLMs that are able to interpret those images into a text representation. https://github.com/getomni-ai/benchmark https://huggingface.co/datasets/getomni-ai/ocr-benchmark https://getomni.ai/ocr-benchmark
comment by themanmaran · 2025-03-06 · in Mistral OCR -
…| 89% | google | 68% | 83% | Currently adding the Mistral API and we'll get results out today! [1] https://github.com/getomni-ai/benchmark [2] https://huggingface.co/datasets/getomni-ai/ocr-benchmark
comment by themanmaran · 2025-03-06 · in Mistral OCR -
We published this benchmark the other week. We'll can update and run with Mistral today! https://github.com/getomni-ai/benchmark
comment by themanmaran · 2025-03-06 · in Mistral OCR -
…improvement, but especially with models like Gemini the accuracy/cost is really competitive. [1] https://github.com/getomni-ai/benchmark
comment by themanmaran · 2025-02-26 · in Replace OCR with Vision Language Models