abi/secret-llama
View on GitHub ↗ ★ 2,679 TypeScript
Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2024-05-03 · latest 2024-05-04
20082026
-
I believe it’s only compatible with full Chrome / Edge https://github.com/abi/secret-llama?tab=readme-ov-file#syste...
comment by spacebanana7 · 2024-05-04 · in Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU -
Models sizes are listed here https://github.com/abi/secret-llama but yeah, > 4GB for the Llama 3 model.
comment by sp332 · 2024-05-03 · in Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPU