Hacker GitHub

← All repos

beir-cellar/beir

View on GitHub ↗ ★ 2,327 Python

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

10 mentions on Hacker News by 4 people: 1 story, 9 comments · first 2022-07-29 · latest 2025-07-31

Mentions per year 10 mentions · busiest year 2022 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …just a guide. It's best to build a test dataset with your own data. This is a good example of that: https://github.com/beir-cellar/beir/wiki/Load-your-custom-da... Another benefit of having your own test dataset, is that it can grow as…
    comment by dmezzetti · 2025-07-31 · in Gemini Embedding: Powering RAG and context engineering
  2. …so the order of magnitude is more indicative. This also matches the case of most public datasets. https://github.com/beir-cellar/beir?tab=readme-ov-file#beers... I guess the intuition is: if the dataset has less than 100 cases, it's…
    comment by codingjaguar · 2024-02-05 · in What I Learned from Building Google Search and How It Inspires RAG Development
  3. The BEIR project might be what you're looking for: https://github.com/beir-cellar/beir/wiki/Leaderboard
    comment by dmezzetti · 2024-01-07 · in Retro on Viberary
  4. ▲ 2
    BEIR: A Heterogeneous Benchmark for Information Retrieval
    story by dmezzetti · 2024-01-03 · 0 comments
  5. …outperforming Elasticsearch in terms of relevance score? I couldn't find Meilisearch listed on https://github.com/beir-cellar/beir .
    comment by snikolaev · 2023-03-30 · in Meilisearch vs. Elasticsearch
  6. …retrieval benchmark [2]. [1] https://docs.google.com/spreadsheets/d/1_ZyYkPJ_K0st9FJBrjbZ... [2] https://github.com/beir-cellar/beir/pull/92
    comment by snikolaev · 2023-02-10 · in Manticore 6.0.0 – a faster alternative to Elasticsearch in C++
  7. …An example dataset is BEIR(BEnchmarking Information Retrieval), published in NIPS 2021: https://github.com/beir-cellar/beir
    comment by sanxiyn · 2022-10-24 · in Sonic: Fast, lightweight and schema-less search backend
  8. …non-tf-idf based search engines would show compared to BM25-based and vector search engines. [1] https://github.com/beir-cellar/beir [2] https://docs.google.com/spreadsheets/d/1_ZyYkPJ_K0st9FJBrjbZ...
    comment by snikolaev · 2022-10-24 · in Sonic: Fast, lightweight and schema-less search backend
  9. Here's a pull request to BEIR to compare Manticore with Elasticsearch in terms of relevance https://github.com/beir-cellar/beir/pull/92 . In this test Manticore provides better relevance than Elasticsearch in average. In general I would…
    comment by snikolaev · 2022-07-29 · in Manticore Search: Elasticsearch Alternative
  10. True! Here's a pull request to BEIR to compare Manticore with Elasticsearch in terms of relevance https://github.com/beir-cellar/beir/pull/92 . Spoiler: in this test Manticore provides better relevance than Elasticsearch in average. Of…
    comment by snikolaev · 2022-07-29 · in Manticore Search: Elasticsearch Alternative