neuml/txtai on Hacker News

As an open source maintainer, I can chime in on this. With TxtAI, I've seen a large uptick in PRs ( https://github.com/neuml/txtai/pulls?q=is%3Apr+is%3Aclosed+s... ). While the extreme verbosity of Claude messages and commits is very…

comment by dmezzetti · 2026-08-12 · in AI is removing the middle class of software engineering?

100% agree on this. I've been working on small local models for years with txtai ( https://github.com/neuml/txtai ). I've published close to 100 models that can run local for RAG, Agents, Vector Search and more (…

comment by dmezzetti · 2026-07-07 · in Small AI Models Gain Traction In places with unreliable networks

…solving other real world problems vs just building software. I've been focused on that with TxtAI ( https://github.com/neuml/txtai ) for 6 years now.

comment by dmezzetti · 2026-06-29 · in Qwen 3.6 27B is the sweet spot for local development

…you can just use Torch or GGUF with compression. Even NumPy can take you a long way. Example below. https://github.com/neuml/txtai/blob/master/examples/78_Acces...

comment by dmezzetti · 2025-11-03 · in The Case Against PGVector

…of using hyperlinks, the links were based on the vector similarity between article abstracts. https://github.com/neuml/txtai/blob/master/examples/58_Advan...

comment by dmezzetti · 2025-08-29 · in Wikipedia as a Graph

…retrieval options that don't require a separate vector database (I'm the author of txtai [ https://github.com/neuml/txtai ], which is one of them). It can be as simple this in Python: you pass an index operation a data generator and save…

comment by dmezzetti · 2025-08-29 · in Show HN: PageIndex – Vectorless RAG

I built TxtAI with this philosophy in mind: https://github.com/neuml/txtai

comment by dmezzetti · 2025-08-08 · in I want everything local – Building my offline AI workspace

…) - Semantic search and workflows for medical/scientific papers. Built on txtai ( https://github.com/neuml/txtai ) paperetl ( https://github.com/neuml/paperetl ) - ETL processes for medical and scientific papers. Supports full PDF docs.

comment by dmezzetti · 2024-12-25 · in Show HN: I made a website to semantically search ArXiv papers

…for a lightweight open-source framework designed to handle the patterns mentioned in this article: https://github.com/neuml/txtai Disclaimer: I'm the author of the framework.

comment by dmezzetti · 2024-12-21 · in Building Effective "Agents"

…has solved many of the problems that many are re-solving with GenAI related databases. With txtai ( https://github.com/neuml/txtai ), I've went all in with Postgres + pgvector. Projects can start small with a SQLite backend then switch the…

comment by dmezzetti · 2024-12-07 · in How to use Postgres for everything

An alternative you can try is txtai ( https://github.com/neuml/txtai ). RAG section: https://github.com/neuml/txtai?tab=readme-ov-file#retrieval-... Disclaimer: I'm the primary developer

comment by dmezzetti · 2024-12-04 · in Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

Thanks for sharing. If you want notebooks that do some of this with local open models: https://github.com/neuml/txtai/tree/master/examples and here: https://gist.github.com/davidmezzetti

comment by dmezzetti · 2024-12-04 · in Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

…in Python, then check out this code. It's has a fairly well-tuned VAD component built-in. https://github.com/neuml/txtai/blob/master/src/python/txtai/...

comment by dmezzetti · 2024-12-04 · in Voice Activity Detection in Elixir with Membran

txtai ( https://github.com/neuml/txtai ) has had inline vectorization since 2020. It supports Transformers, llama.cpp and LLM API services. It also has inline integration with LLM models and a built-in RAG pipeline.

comment by dmezzetti · 2024-12-04 · in Pinecone integrates AI inferencing with vector database

…when BM25 scores are normalized and reciprocal rank fusion (RRF) when they aren't [4]. [1] https://github.com/neuml/txtai [2] https://neuml.hashnode.dev/building-an-efficient-sparse-keyw... [3] https://neuml.hashnode.dev/benefits-of-hybrid-…

comment by dmezzetti · 2024-11-20 · in Understanding the BM25 full text search algorithm

GitHub: https://github.com/neuml/txtai Release Notes: https://github.com/neuml/txtai/releases/tag/v8.0.0 Example Notebook: https://colab.research.google.com/github/neuml/txtai/blob/ma...

comment by dmezzetti · 2024-11-19 · in txtai 8.0 released: an agent framework for minimalists

Author of txtai ( https://github.com/neuml/txtai ) here. I've been in the embeddings space since 2020 before the world of LLMs/GenAI. In principle, I agree with much of the sentiment here. Embeddings can get you pretty far. If the goal is…

comment by dmezzetti · 2024-11-01 · in Embeddings are underrated

…brought up in a discussion yesterday. I saved it to look at later. But you might find it useful. https://github.com/neuml/txtai Here is that that thread. https://news.ycombinator.com/item?id=41981907

comment by depingus · 2024-10-31 · in Ask HN: Local RAG with private knowledge base

…into txtai during 2023. The next release will be a major release (8.0) with agent support ( https://github.com/neuml/txtai/issues/804 ). I've been hesitant to buy into the "agentic" hype as it seems quite convoluted and complicated at this…

comment by dmezzetti · 2024-10-29 · in Ask HN: Real-time speech-to-speech translation

A similar option exists with txtai ( https://github.com/neuml/txtai ). https://neuml.hashnode.dev/speech-to-speech-rag https://www.youtube.com/watch?v=tH8QWwkVMKA One would just need to remove the RAG piece and use a Translation pipeline (…

comment by dmezzetti · 2024-10-29 · in Ask HN: Real-time speech-to-speech translation

In a crowded "AI space", I continue to work on txtai ( https://github.com/neuml/txtai ) for semantic search, LLM orchestration and language model workflows. It's not as popular as the big frameworks but I believe it's a better solution.…

comment by dmezzetti · 2024-10-28 · in Ask HN: What are you working on? (October 2024)

…There are frameworks such as LangChain, LlamaIndex and txtai (disclaimer I'm the primary author of https://github.com/neuml/txtai ) that handle generating embeddings locally or with APIs and storing them in databases such as Postgres.

comment by dmezzetti · 2024-08-17 · in Just use Postgres

…the problem, similar to how the Baseball workflow is on txtai - but in a more robust manner. https://github.com/neuml/txtai/blob/master/examples/42_Promp... Where I can build particular query bots that can search properly based on the…

comment by samstave · 2024-08-11 · in Ask HN: Discernment Lattice [Prompting]

…With a repo of Lattices which can then be used in conjunction with txtai workflow functions: https://github.com/neuml/txtai/tree/master/examples Where the Lattice could be a series of things that you want to connect people places and…

comment by samstave · 2024-08-11 · in Ask HN: Discernment Lattice [Prompting]

…txtai workflows surrounding things you already do, would allow you to then NLP /GPT your infra. https://github.com/neuml/txtai/tree/master/examples Use AI to help you document everything. Feed it a piece of code, and tell it to explain its…

comment by samstave · 2024-08-09 · in Ask HN: Company wants us to upskill in AI. What is the best approach?

…so I wanted to share this project as many don't know it exists. Link to source (Apache 2.0): https://github.com/neuml/txtai

comment by dmezzetti · 2024-07-21 · in Txtai: Open-source vector search and RAG for minimalists

Link to source (Apache 2.0): https://github.com/neuml/txtai

comment by dmezzetti · 2024-07-21 · in Txtai: Open-source vector search and RAG for minimalists

Link to source (Apache 2.0): https://github.com/neuml/txtai

comment by dmezzetti · 2024-07-15 · in txtai 7.3 released: Adds new RAG Web Apps and streaming LLM/RAG support

…BM25 Python library most commonly used. txtai is Apache 2.0 licensed and all code is available at https://github.com/neuml/txtai

comment by dmezzetti · 2024-07-08 · in Show HN: txtai: open-source, production-focused vector search and RAG

…project as many don't know it exists. txtai is Apache 2.0 licensed and all code is available at https://github.com/neuml/txtai

comment by dmezzetti · 2024-06-29 · in txtai: Vector search, Knowledge Graphs, RAG and LLM workflows locally run

An alternative is using txtai ( https://github.com/neuml/txtai ). It's lightweight and works with both local and remote LLMs. Here is an example article that shows how to use OpenAI calls with txtai: https://neuml.hashnode.dev/rag-with-llam…

comment by dmezzetti · 2024-06-22 · in Why we no longer use LangChain for building our AI agents

…of the first and still the best open source package for creating or working with semantic graphs. https://github.com/neuml/txtai/blob/master/examples/38_Intro...

comment by Der_Einzige · 2024-04-29 · in Memary: Open-Source Longterm Memory for Autonomous Agents

…will increase the likelihood of a PR being merged. Disclaimer: I'm the primary developer of txtai ( https://github.com/neuml/txtai ), an open-source vector database + RAG framework

comment by dmezzetti · 2024-04-27 · in What contributing to Open-source is, and what it isn't

txtai ( https://github.com/neuml/txtai ), an embeddings database for semantic search, graph networks and RAG

comment by dmezzetti · 2024-02-05 · in Ask HN: What have you built with LLMs?

…route. I've been able to build a fairly successful open source project (txtai 6K stars https://github.com/neuml/txtai ) and a revenue positive company. It's a "live within your means" strategy. VC funding can have a snowball effect where…

comment by dmezzetti · 2024-02-05 · in Bootstrap or VC? [video]

…next Steve Jobs. I've been able to build a fairly successful open source project (txtai 6K stars https://github.com/neuml/txtai ) and a revenue positive company. For me, authenticity and being genuine is most important. I would say that…

comment by dmezzetti · 2024-01-27 · in Ask HN: What happened to startups, why is everything so polished?

I'll add txtai ( https://github.com/neuml/txtai ) to the list. There is still plenty of room for innovation in this space. Just need to focus on the right projects that are innovating and not the ones (re)working on problems solved in…

comment by dmezzetti · 2024-01-26 · in Are we at peak vector database?

…https://neuml.hashnode.dev/extract-text-from-documents Disclaimer: I'm the primary author of txtai ( https://github.com/neuml/txtai ).

comment by dmezzetti · 2024-01-24 · in Show HN: Open-source Rule-based PDF parser for RAG

…a full vector index implementation. https://neuml.hashnode.dev/external-database-integration https://github.com/neuml/txtai Disclaimer: I'm the primary author of txtai

comment by dmezzetti · 2024-01-17 · in Benchmarking Postgres Vector Search Approaches: Pgvector vs. Lantern

…txtai has a semantic graph component. https://neuml.hashnode.dev/introducing-the-semantic-graph https://github.com/neuml/txtai Disclaimer: I'm the primary author of txtai

comment by dmezzetti · 2024-01-17 · in RAG Using Unstructured Data and Role of Knowledge Graphs

You can take a look at txtai ( https://github.com/neuml/txtai ). It can run in a Python process. It has support for storing content in SQLite and embeddings vectors in local vector index formats (Faiss, HNSW, Annoy). Disclaimer: I'm the…

comment by dmezzetti · 2024-01-12 · in Vector Databases: A Technical Primer [pdf]

fwiw this link looks interesting, everyone https://github.com/neuml/txtai

comment by mistrial9 · 2024-01-07 · in Ten Noteworthy AI Research Papers of 2023

…built on Transformers that makes it easier. For example, you can run LLM inference with txtai ( https://github.com/neuml/txtai ) in Python using the following 3 lines of code. from txtai.pipeline import LLM llm =…

comment by dmezzetti · 2023-12-31 · in TinyLlama a 1.1B Llama model trained on 3T tokens reaches 1.0 release

My perspective as an open source developer of txtai ( https://github.com/neuml/txtai ). When you get started in open source, it's a great way for a small team to get the word out. Conversely, when starting as proprietary software or SaaS,…

comment by dmezzetti · 2023-12-26 · in The life and death of open source companies

You can look at https://github.com/neuml/txtai . Biggest thing of 2023 was RAG with models like Mistral.

comment by dmezzetti · 2023-12-25 · in 2023: The Year of AI

…are easier to integrate and perform better for your use case. Disclaimer: I am the author of txtai: https://github.com/neuml/txtai

comment by dmezzetti · 2023-12-20 · in Build a search engine, not a vector DB

It's a great tool. I've used it to design all my documentation for txtai. https://github.com/neuml/txtai

comment by dmezzetti · 2023-12-03 · in Open-source drawing tool – Excalidraw

…Looks like you've received a lot of great ideas here already though! 1 - https://github.com/neuml/txtai

comment by dmezzetti · 2023-11-30 · in Is anyone using self hosted LLM day to day and training it like a new employee

…papers. Supports LLM prompting, semantic workflows and vector search. Built with txtai ( https://github.com/neuml/txtai ). While arbitrary chunking/splitting can work, I've found that integrating parsing that has knowledge of…

comment by dmezzetti · 2023-11-26 · in Oracle of Zotero: LLM QA of Your Research Library

I've seen a number of projects come over the last couple years. I'm the author of txtai ( https://github.com/neuml/txtai ) which I started in 2020. How you approach performance is the key point. You can write performant code in any…

comment by dmezzetti · 2023-11-26 · in VectorDB: Vector Database Built by Kagi Search