intel/ipex-llm
View on GitHub ↗ ★ 8,845 Python archived
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
18 mentions on Hacker News by 12 people: 7 stories, 11 comments · first 2016-12-31 · latest 2026-08-09
20082026
-
(Apparently supersedes ipex-llm: https://github.com/intel/ipex-llm )
comment by peter_d_sherman · 2026-08-09 · in LLM Scaler – LLM Support for Intel's Arc Pro B60 and B70 GPUs -
▲ 2
FlashMoE: DeepSeek-R1 671B and Qwen3MoE 235B with 1~2 Intel B580 GPU in IPEX-LLMstory by colorant · 2025-05-13 · 1 comment
-
…numbers on the github's root page, but it does not appear to include the new deepseek yet: https://github.com/intel/ipex-llm/tree/main?tab=readme-ov-fi...
comment by yvdriess · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon -
See this section https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic...
comment by colorant · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon -
https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic... Requirements (>8 token/s): 380GB CPU Memory 1-8 ARC A770 500GB Disk
comment by colorant · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon -
…using 0/1/2..8 Arc A770 GPUs. Also, it's probably better to link straight to the relevant section https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic...
comment by zamadatix · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon -
▲ 297
DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeonstory by colorant · 2025-03-06 · 112 comments
-
…good laptop options - the Lenovo Yoga Aura edition is pretty much macbook quality. And runs LLMs ( https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Over... )
comment by sandGorgon · 2025-03-05 · in MacBook Air M4 -
▲ 2
IPEX-LLM Portable Zip for Ollama on Intel GPUstory by colorant · 2025-02-14 · 2 comments
-
…most people. Curious if anyone else has experience with the A770 for LLM? Been looking at Intel's https://github.com/intel/ipex-llm project and it looked pretty promising, that's what made me pull the trigger in the end. Am I making a huge…
comment by lewisl9029 · 2025-02-11 · in Building a personal, private AI computer on a budget -
There is ipex-llm support for Ollama on Intel GPU ( https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic... )
comment by colorant · 2025-02-03 · in Llama.cpp supports Vulkan. why doesn't Ollama? -
…Linux, as in "just works". Remains to be seen whether Battlemage will have day one support, though. https://github.com/intel-analytics/ipex-llm/
comment by washadjeffmad · 2024-12-13 · in Intel built best budget GPU for 1440p gaming -
…RNDA3 is much more mature (while not always the fastest, most basic things do just work now). [1] https://github.com/intel-analytics/ipex-llm [2] https://github.com/intel/intel-extension-for-pytorch [3]…
comment by lhl · 2024-12-04 · in Intel announces Arc B-series "Battlemage" discrete graphics with Linux support -
Any performance benchmark against intel's 'IPEX-LLM'[0] or others? [0] - https://github.com/intel-analytics/ipex-llm
comment by DrNosferatu · 2024-04-03 · in LLaMA now goes faster on CPUs -
▲ 308
PyTorch Library for Running LLM on Intel CPU and GPUstory by ebalit · 2024-04-03 · 95 comments
-
▲ 1
BigDL-LLM: running LLM on your laptop using INT4story by colorant · 2023-07-03 · 1 comment
-
▲ 2
Fast, distributed, secure AI for Big Datastory by fzliu · 2023-06-29 · 0 comments
-
▲ 112
BigDL: Distributed Deep Learning on Apache Sparkstory by ubolonton_ · 2016-12-31 · 37 comments