Hacker GitHub

← All repos

qualcomm/GenieX

View on GitHub ↗ ★ 8,486 Go

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

10 mentions on Hacker News by 6 people: 6 stories, 4 comments · first 2024-09-08 · latest 2024-11-01

Mentions per year 10 mentions · busiest year 2024 (10)
20082026
AllStoriesComments NewestTopOldest
  1. …We built an open-sourced tool to benchmark GGUF models with a single line of code. GitHub Link: https://github.com/NexaAI/nexa-sdk/tree/main/nexa/eval Motivations: GGUF quantization is crucial for running models locally on devices, but…
    comment by alanzhuly · 2024-10-24 · in Benchmark GGUF model with ONE line of code
  2. …models). For anyone looking for a simple way to test Llama3.2 3B locally with UI, Install nexa-sdk( https://github.com/NexaAI/nexa-sdk ) and type in terminal: nexa run llama3.2 --streamlit Disclaimer: I am from Nexa AI and nexa-sdk is an…
    comment by alanzhuly · 2024-09-26 · in Llama 3.2: Revolutionizing edge AI and vision with open, customizable models
  3. …find local models optimized for your device. Nexa AI local model hub: https://nexaai.com/ Toolkit: https://github.com/NexaAI/nexa-sdk It also comes with a built-in local UI to get started with local models easily and OpenAI-compatible API…
    comment by alanzhuly · 2024-09-21 · in Forget ChatGPT: why researchers now run small AIs on their laptops
  4. Here's some demos we built with the Nexa SDK: ( https://github.com/NexaAI/nexa-sdk/tree/main/examples ) We're also planning to have an app gallery where developers can upload their on-device AI apps built with the Nexa SDK. We'll aim to…
    comment by frednoodle · 2024-09-08 · in Show HN: Nexa SDK – Build powerful and efficient AI apps on edge devices