Hacker GitHub

← All repos

getomni-ai/benchmark

View on GitHub ↗ ★ 640 TypeScript

OCR Benchmark

10 mentions on Hacker News by 2 people: 2 stories, 8 comments · first 2025-02-20 · latest 2025-04-01

Mentions per year 10 mentions · busiest year 2025 (10)
20082026
AllStoriesComments NewestTopOldest
  1. Yup, they did. The beauty of version control: https://github.com/getomni-ai/benchmark/commit/0544e2a439423...
    comment by axpy906 · 2025-04-01 · in Show HN: Qwen-2.5-32B is now the best open source OCR model
  2. ▲ 211
    Show HN: Qwen-2.5-32B is now the best open source OCR model
    story by themanmaran · 2025-04-01 · 47 comments
  3. …benchmark runner is fully open source. You can check out the code and reproduction steps here: - https://github.com/getomni-ai/benchmark - https://huggingface.co/datasets/getomni-ai/ocr-benchmark
    comment by themanmaran · 2025-03-28 · in Benchmarking open source VLMs for OCR
  4. …OCR text from Mistral and it scores 70%, that means the inaccuracies are isolated to OCR errors. https://github.com/getomni-ai/benchmark
    comment by themanmaran · 2025-03-07 · in Mistral OCR
  5. …Compared to the other VLMs that are able to interpret those images into a text representation. https://github.com/getomni-ai/benchmark https://huggingface.co/datasets/getomni-ai/ocr-benchmark https://getomni.ai/ocr-benchmark
    comment by themanmaran · 2025-03-06 · in Mistral OCR
  6. …Compared to the other VLMs that are able to interpret those images into a text representation. https://github.com/getomni-ai/benchmark https://huggingface.co/datasets/getomni-ai/ocr-benchmark https://getomni.ai/ocr-benchmark
    comment by themanmaran · 2025-03-06 · in Mistral OCR
  7. …| 89% | google | 68% | 83% | Currently adding the Mistral API and we'll get results out today! [1] https://github.com/getomni-ai/benchmark [2] https://huggingface.co/datasets/getomni-ai/ocr-benchmark
    comment by themanmaran · 2025-03-06 · in Mistral OCR
  8. We published this benchmark the other week. We'll can update and run with Mistral today! https://github.com/getomni-ai/benchmark
    comment by themanmaran · 2025-03-06 · in Mistral OCR
  9. …improvement, but especially with models like Gemini the accuracy/cost is really competitive. [1] https://github.com/getomni-ai/benchmark
    comment by themanmaran · 2025-02-26 · in Replace OCR with Vision Language Models
  10. ▲ 146
    Show HN: Benchmarking VLMs vs. Traditional OCR
    story by themanmaran · 2025-02-20 · 40 comments