plasticityai/magnitude
View on GitHub ↗ ★ 1,675 Python
A fast, efficient universal vector embedding utility package.
11 mentions on Hacker News by 3 people: 1 story, 10 comments · first 2018-02-26 · latest 2024-09-16
20082026
-
Interesting... looks like this uses pymagnitude https://github.com/plasticityai/magnitude
comment by xk3 · 2024-09-16 · in Show HN: Wordllama – Things you can do with the token embeddings of an LLM -
…magnitude [1] is an easy to use library. (3) FastText now supports multiple languages [2]. [1] https://github.com/plasticityai/magnitude#pre-converted-magn... [2] https://fasttext.cc/docs/en/crawl-vectors.html#models
comment by abhgh · 2021-06-24 · in FastText is the best text classification library for a quick baseline -
Check out Magnitude, we built it to solve that problem: https://github.com/plasticityai/magnitude It's still loaded from a file, but heavily uses memory-mapping and caching to be speedy and not overload your RAM immediately. And in…
comment by patelajay285 · 2021-04-22 · in Pgvector – vector similarity search for Postgres -
Our startup made a package powered by SQLite for this very purpose: https://github.com/plasticityai/magnitude Might be worth checking out :)
comment by patelajay285 · 2021-04-22 · in Pgvector – vector similarity search for Postgres -
See my top-level reply about a similar library called Magnitude that we have built and open-sourced: https://github.com/plasticityai/magnitude . It actually utilizes an LRU cache (configurable cache size argument on the constructor) so you…
comment by patelajay285 · 2018-09-06 · in Fast word vectors with little memory usage in Python -
…interesting work. We at Plasticity (YC S17) have open sourced something similar called Magnitude ( https://github.com/plasticityai/magnitude ) a few months ago for querying vector embeddings quickly with low memory usage using SQLite and a…
comment by patelajay285 · 2018-09-06 · in Fast word vectors with little memory usage in Python -
…to quickly get started with pre-built models, it might be worth checking out along with Gensim: https://github.com/plasticityai/magnitude/
comment by patelajay285 · 2018-03-22 · in Exploring Word2Vec -
We recently open sourced a library that does exactly this: https://github.com/plasticityai/magnitude For word2vec, GloVE, and fastText. It is able to generate vectors for out-of-vocabulary words through "fragments" of words or subword…
comment by patelajay285 · 2018-03-20 · in Show HN: Word2Bits – Quantized Word Vectors -
…words and uses Annoy indexing for fast most_similar queries for word2vec, GloVE, and fastText: https://github.com/plasticityai/magnitude
comment by patelajay285 · 2018-03-02 · in Understanding word vectors -
…open source library that can help you get started with pre-trained word vectors and Annoy quickly: https://github.com/plasticityai/magnitude
comment by patelajay285 · 2018-03-02 · in Understanding word vectors