huggingface/text-embeddings-inference
View on GitHub ↗ ★ 5,116 Rust
A blazing fast inference solution for text embeddings models
6 mentions on Hacker News by 4 people: 1 story, 5 comments · first 2023-10-14 · latest 2026-02-01
20082026
-
…- Voyage AI (rerank-2.5) - Jina AI (jina-reranker-v3) Self-hosted (no API key needed): - TEI - https://github.com/huggingface/text-embeddings-inference - vLLM - https://docs.vllm.ai/en/v0.8.1/serving/openai_compatible_server.html#rerank-api…
comment by svcrunch · 2026-02-01 · in Tuning Semantic Search on JFMM.net – Joint Fleet Maintenance Manual -
…In our hosting all instances default to having the vector features enabled, we run embeddings using https://github.com/huggingface/text-embeddings-inference
comment by xfalcox · 2025-11-04 · in The Case Against PGVector -
…transition even with millions of embeddings across thousands of databases. I do recommend using https://github.com/huggingface/text-embeddings-inference for fast inference.
comment by xfalcox · 2025-08-23 · in Embedding Text Documents with Qwen3 -
…it does appear to support Roberta architecture classifiers (specifically sentiment analysis). https://github.com/huggingface/text-embeddings-inference You can always run a zero shot pipeline in HF with a simple Flask/FastAPI application.
comment by pilotneko · 2024-10-07 · in Zero-Shot Text Classification on a low-end CPU-only machine? -
Worth noting that this also impacts the great https://github.com/huggingface/text-embeddings-inference , which allows anyone to run state of the art embeddings with great performance.
comment by xfalcox · 2024-04-08 · in HuggingFace text-generation-inference is reverting to Apache 2.0 License -
▲ 3
Fast inference for text models using Ruststory by l-m-z · 2023-10-14 · 0 comments