NVIDIA/ChatRTX
View on GitHub ↗ ★ 3,109 Python archived
A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM
3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2024-02-13 · latest 2024-05-10
20082026
-
The software ChatWithRTX is based on can be rebuild and might be able to be reconfigured to work: https://github.com/NVIDIA/trt-llm-rag-windows https://github.com/NVIDIA/TensorRT-LLM
comment by compressedgas · 2024-05-10 · in Are there any alternatives to Nvidia's AI Chat with RTX? -
Having installed this, this is an incredibly then wrapper around the following github repos: https://github.com/NVIDIA/trt-llm-rag-windows https://github.com/NVIDIA/TensorRT-LLM It's quite a thin wrapper around putting both projects into…
comment by operator-name · 2024-02-13 · in Nvidia's Chat with RTX is an AI chatbot that runs locally on your PC -
The source is available, minus the installer. You could always use the base repo after verifying it: https://github.com/NVIDIA/trt-llm-rag-windows
comment by operator-name · 2024-02-13 · in Nvidia's Chat with RTX is an AI chatbot that runs locally on your PC