Hacker GitHub

← All repos

intel/ipex-llm

View on GitHub ↗ ★ 8,845 Python archived

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

18 mentions on Hacker News by 12 people: 7 stories, 11 comments · first 2016-12-31 · latest 2026-08-09

Mentions per year 18 mentions · busiest year 2025 (10)
20082026
  1. ▲ 2
    FlashMoE: DeepSeek-R1 671B and Qwen3MoE 235B with 1~2 Intel B580 GPU in IPEX-LLM
    story by colorant · 2025-05-13 · 1 comment
  2. ▲ 297
    DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon
    story by colorant · 2025-03-06 · 112 comments
  3. ▲ 2
    IPEX-LLM Portable Zip for Ollama on Intel GPU
    story by colorant · 2025-02-14 · 2 comments
  4. ▲ 308
    PyTorch Library for Running LLM on Intel CPU and GPU
    story by ebalit · 2024-04-03 · 95 comments
  5. ▲ 1
    BigDL-LLM: running LLM on your laptop using INT4
    story by colorant · 2023-07-03 · 1 comment
  6. ▲ 2
    Fast, distributed, secure AI for Big Data
    story by fzliu · 2023-06-29 · 0 comments
  7. ▲ 112
    BigDL: Distributed Deep Learning on Apache Spark
    story by ubolonton_ · 2016-12-31 · 37 comments