intel/ipex-llm
View on GitHub ↗ ★ 8,845 Python archived
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
18 mentions on Hacker News by 12 people: 7 stories, 11 comments · first 2016-12-31 · latest 2026-08-09
20082026
-
▲ 2
FlashMoE: DeepSeek-R1 671B and Qwen3MoE 235B with 1~2 Intel B580 GPU in IPEX-LLMstory by colorant · 2025-05-13 · 1 comment
-
▲ 297
DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeonstory by colorant · 2025-03-06 · 112 comments
-
▲ 2
IPEX-LLM Portable Zip for Ollama on Intel GPUstory by colorant · 2025-02-14 · 2 comments
-
▲ 308
PyTorch Library for Running LLM on Intel CPU and GPUstory by ebalit · 2024-04-03 · 95 comments
-
▲ 1
BigDL-LLM: running LLM on your laptop using INT4story by colorant · 2023-07-03 · 1 comment
-
▲ 2
Fast, distributed, secure AI for Big Datastory by fzliu · 2023-06-29 · 0 comments
-
▲ 112
BigDL: Distributed Deep Learning on Apache Sparkstory by ubolonton_ · 2016-12-31 · 37 comments