postgrespro/rum on Hacker News

There was some work toward this, not sure about its current status: https://github.com/postgrespro/rum Badly needed.

comment by SigmundA · 2024-08-07 · in Full text search over Postgres: Elasticsearch vs. alternatives

…who wrote core text search and json indexing. not sure why rum not in core. we have no problems. https://github.com/postgrespro/rum

comment by johnthescott · 2024-04-11 · in Code search is hard

the pg extension called "rum" is very performant on millions of pdfs. https://github.com/postgrespro/rum

comment by johnthescott · 2023-11-26 · in Investing in new vector database development vs enhancing existing databases

…like faster ranking of results in full-text search, with GIN indices including positional information, like github.com/postgrespro/rum.

comment by ngrilly · 2023-01-29 · in Features I'd Like in PostgreSQL

…Better full-text scoring is one for me that's missing in that list, TF/IDF or BM25 please see: https://github.com/postgrespro/rum

comment by SigmundA · 2023-01-28 · in Features I'd Like in PostgreSQL

…over the core fts. rum is written by postgrespro, who also wrote core fts and json indexing in pg. https://github.com/postgrespro/rum rum handles +20mil pdf pages, interactively.

comment by johnthescott · 2022-11-25 · in Ask HN: Books about full text search?

…is no index that helps scoring results. You would have to install an extension like RUM index ( https://github.com/postgrespro/rum ) to improve this, which may or may not be an option (often not if you use managed databases). If you want a…

comment by soft_dev_person · 2022-10-15 · in Postgres Full Text Search vs. the Rest

…such as TF/IDF or BM25. PG seems to lag behind here and hasn't be a lot of movement in a while 1. https://github.com/postgrespro/rum

comment by SigmundA · 2022-10-14 · in Postgres Full Text Search vs. the Rest

Mandatory mention of the RUM extension ( https://github.com/postgrespro/rum ) if this caught your eye. Lots of tutorials and conference presentations out there showcasing the advantages in terms of ranking, timestamps...

comment by puika · 2022-07-11 · in Postgres full-text search: A search engine in a database (2021)

▲ 2

Postgrespro/rum: RUM access method – inverted index with additional information

story by xojoc · 2021-12-17 · 0 comments

…results. The GIN indexes for FTS don't really work in conjunction with other indices, which is why https://github.com/postgrespro/rum exists. Luckily, it sounds like you can use your existing indices to filter and let postgres scan for…

comment by john-shaffer · 2021-07-27 · in Postgres Full-Text Search: A search engine in a database

That why this really needs to get merged: https://github.com/postgrespro/rum

comment by SigmundA · 2021-07-27 · in Postgres Full-Text Search: A search engine in a database

…faster and better ranking (TF/IDF). Really would make PG a much more complete text search engine. https://github.com/postgrespro/rum

comment by SigmundA · 2021-07-27 · in Postgres Full-Text Search: A search engine in a database

…has been that sorting by relevance ranking is quite expensive. I looked into this a bit and found https://github.com/postgrespro/rum (and some earlier slide decks about it) that explains why the GIN index type can't support searching and…

comment by grncdr · 2021-07-27 · in Postgres Full-Text Search: A search engine in a database

…[2] - slides https://www.pgcon.org/2019/schedule/attachments/541_Let's%20... [3] - https://github.com/postgrespro/rum

comment by mulander · 2021-05-15 · in Debugging random slow writes in PostgreSQL

I suggest to have a look at https://github.com/postgrespro/rum if you haven’t yet. It solves the issue of slow ranking in PostgreSQL FTS.

comment by ngrilly · 2021-01-24 · in Show HN: Full text search Project Gutenberg (60m paragraphs)

…be introduced into the pg core soon. we index many terabytes of pdf files excellent performance. https://github.com/postgrespro/rum also, postgrespro are behind the json/b indexing.

comment by johnthescott · 2020-09-14 · in Old, Good Database Design

…Algolia but it could be a whole lot better for many use cases specifically TF/IDF and BM25 scoring: https://github.com/postgrespro/rum

comment by SigmundA · 2020-07-02 · in Algolia introduces pay-as-you-go pricing for search

Would like to see this work integrated: https://github.com/postgrespro/rum

comment by SigmundA · 2020-02-03 · in The state of full text search in PostgreSQL 12

PG could really do most of it if they got serious about https://github.com/postgrespro/rum with TF/IDF ranking.

comment by SigmundA · 2020-02-03 · in The state of full text search in PostgreSQL 12

…allowing for a simple, elegant classification: find all queries which match a certain document. https://github.com/postgrespro/rum

comment by johnthescott · 2019-11-01 · in Fine tuning full text search with PostgreSQL 12

…we have the text search index easily handling 20mil+ pdfs with the rum index from postgrespro http://github.com/postgrespro/rum .

comment by johnthescott · 2019-10-17 · in Amazon’s Consumer Business Turned Off Final Oracle Database

…also BM25. There has been some work but not sure when it will be stable, needs a new kind of index: https://github.com/postgrespro/rum

comment by SigmundA · 2019-09-19 · in Challenges in Implementing a Full-Text-Search Engine

…is definitely A Problem I Would Love To Have ;) EDIT: This seems to help with the ranking problem: https://github.com/postgrespro/rum

comment by pmarreck · 2019-07-22 · in Ask HN: Are Lucene/Solr/ES Still Used for Search?

https://github.com/postgrespro/rum

comment by ngrilly · 2019-07-20 · in Ask HN: Are Lucene/Solr/ES Still Used for Search?

Still waiting for PostgreSQL to implement TF-IDF ranking: https://github.com/postgrespro/rum

comment by SigmundA · 2019-04-10 · in TF-IDF in a Nutshell

…indexes do not store enough information to use better scoring and RUM indexes could change that: https://github.com/postgrespro/rum

comment by SigmundA · 2018-09-11 · in PostgreSQL 11 and Just in Time Compilation of Queries

…style rank generation ? The work on RUM seems to have stagnated (and TF-IDF was a todo anyhow here) https://github.com/postgrespro/rum I have a theory that if they incorporate these algorithms, it makes postgres potent enough that a lot of…

comment by sandGorgon · 2018-07-29 · in Setting Up a Fast, Comprehensive Search Routine with PostgreSQL

…The downside: ranking can be slow when your keywords match a large number of documents (have a look at github.com/postgrespro/rum for a solution), and faceting is more difficult to implement than in ElasticSearch

comment by ngrilly · 2018-07-29 · in Setting Up a Fast, Comprehensive Search Routine with PostgreSQL

…row, and this can be really slow. People are working on this but it's not in PostgreSQL core yet: https://github.com/postgrespro/rum . This is why I'm a bit surprised by the numbers you shared: fulltext search on 270 million rows in below…

comment by ngrilly · 2017-09-17 · in Migrating from RethinkDB to Postgres – An Experience Report

…on the same topic which are interesting. You can see the RUM index (which has faster ranking here): https://github.com/postgrespro/rum

comment by renesd · 2017-02-14 · in Is PostgreSQL good enough?

…index, that should improve ranking: https://www.pgcon.org/2016/schedule/attachments/436_pgcon-20... https://github.com/postgrespro/rum

comment by okket · 2016-10-02 · in Postgres full-text search is Good Enough (2015)

…few days ago: https://news.ycombinator.com/item?id=12605156 And this new index type for PostgreSQL: https://github.com/postgrespro/rum

comment by ngrilly · 2016-10-02 · in Postgres full-text search is Good Enough (2015)