ngxson/wllama
View on GitHub ↗ ★ 1,363 TypeScript
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
7 mentions on Hacker News by 7 people: 2 stories, 5 comments · first 2024-05-22 · latest 2025-09-08
20082026
-
…I can see the appeal of having it all just run in the browser. https://github.com/mlc-ai/web-llm https://github.com/ngxson/wllama
comment by craftkiller · 2025-09-08 · in Experimenting with Local LLMs on macOS -
This is an in-browser llamacpp implementation: https://github.com/ngxson/wllama And related is the whisper implementation: https://ggml.ai/whisper.cpp/
comment by generalizations · 2025-09-08 · in Experimenting with Local LLMs on macOS -
…should be what you're looking for. It doesn't utilize the GPU, but WebGL support is in the TODOs. https://github.com/ngxson/wllama https://huggingface.co/spaces/ngxson/wllama
comment by SparkyMcUnicorn · 2025-09-08 · in Experimenting with Local LLMs on macOS -
The model remains cached in the OPFS. If you're curious about the caching code, it can be found here: https://github.com/ngxson/wllama/blob/c267097dc79df8d23df8bc...
comment by nadchif · 2025-08-27 · in Show HN: Run AI models directly in the browser – no server or internet required -
…the beginning, it was made to run on the browsers of Chrome/Safari/Firefox Mobile, and [Wllama]( https://github.com/ngxson/wllama ) together with [Web-LLM]( https://github.com/mlc-ai/web-llm ), along with LLMs of <1B parameters, allowed…
comment by felladrin · 2024-10-14 · in Show HN: Self-hosteable browser-based minimalist web-searching platform