Hacker GitHub

← All repos

off-grid-ai/OGAM

View on GitHub ↗ ★ 3,317 TypeScript

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

14 mentions on Hacker News by 8 people: 5 stories, 9 comments · first 2026-02-14 · latest 2026-05-31

Mentions per year 14 mentions · busiest year 2026 (14)
20082026
  1. …quite as useful. I do wonder how these compare to existing image generation models. I've tried https://github.com/alichherawalla/off-grid-mobile-ai for a while but I find the image generation models rather lacking.
  2. …about now? https://apfel.franzai.com/ (iOS/MacOS, runs the 3B param model already bundled for Siri) https://github.com/alichherawalla/off-grid-mobile-ai (Android, runs ~7B models on flagship phones at 15-30tok/s) Foundation model…
    comment by garethsprice · 2026-04-23 · in LLM pricing has never made sense
  3. …effort are there other open projects for running small models locally on android / iOS? I've found https://github.com/alichherawalla/off-grid-mobile-ai but haven't tried anything in this space yet.
    comment by getpokedagain · 2026-03-25 · in Ensu – Ente’s Local LLM app
  4. …lets you run any model from Hugging Face (of course you need to choose one your phone can handle). https://github.com/alichherawalla/off-grid-mobile-ai
    comment by maxloh · 2026-03-25 · in Ensu – Ente’s Local LLM app
  5. ofcourse ofcourse, I've documented everything here: https://github.com/alichherawalla/off-grid-mobile-ai/blob/ma... llama.cpp compiled as a native Android library via the NDK, linked into React Native through a custom JSI bridge. GGUF…
  6. https://github.com/alichherawalla/off-grid-mobile
  7. hey, just pushed a fix for it here: https://github.com/alichherawalla/off-grid-mobile/releases/t... Thanks for spotting and reporting this.
  8. I found more info https://github.com/alichherawalla/off-grid-mobile/blob/main/...
  9. …as offgrid-mobile everywhere on that page but is off-grid-mobile. So the lastest releases is at https://github.com/alichherawalla/off-grid-mobile/releases/l... And the clone would be: git clone https://github.com/alichherawalla/off-grid-mob…