Hacker GitHub

← All repos

intel/ipex-llm

View on GitHub ↗ ★ 8,845 Python archived

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

18 mentions on Hacker News by 12 people: 7 stories, 11 comments · first 2016-12-31 · latest 2026-08-09

Mentions per year 18 mentions · busiest year 2025 (10)
20082026
AllStoriesComments NewestTopOldest
  1. (Apparently supersedes ipex-llm: https://github.com/intel/ipex-llm )
    comment by peter_d_sherman · 2026-08-09 · in LLM Scaler – LLM Support for Intel's Arc Pro B60 and B70 GPUs
  2. …numbers on the github's root page, but it does not appear to include the new deepseek yet: https://github.com/intel/ipex-llm/tree/main?tab=readme-ov-fi...
    comment by yvdriess · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon
  3. See this section https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic...
    comment by colorant · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon
  4. https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic... Requirements (>8 token/s): 380GB CPU Memory 1-8 ARC A770 500GB Disk
    comment by colorant · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon
  5. …using 0/1/2..8 Arc A770 GPUs. Also, it's probably better to link straight to the relevant section https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic...
    comment by zamadatix · 2025-03-06 · in DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeon
  6. …good laptop options - the Lenovo Yoga Aura edition is pretty much macbook quality. And runs LLMs ( https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Over... )
    comment by sandGorgon · 2025-03-05 · in MacBook Air M4
  7. …most people. Curious if anyone else has experience with the A770 for LLM? Been looking at Intel's https://github.com/intel/ipex-llm project and it looked pretty promising, that's what made me pull the trigger in the end. Am I making a huge…
    comment by lewisl9029 · 2025-02-11 · in Building a personal, private AI computer on a budget
  8. There is ipex-llm support for Ollama on Intel GPU ( https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quic... )
    comment by colorant · 2025-02-03 · in Llama.cpp supports Vulkan. why doesn't Ollama?
  9. …Linux, as in "just works". Remains to be seen whether Battlemage will have day one support, though. https://github.com/intel-analytics/ipex-llm/
    comment by washadjeffmad · 2024-12-13 · in Intel built best budget GPU for 1440p gaming
  10. …RNDA3 is much more mature (while not always the fastest, most basic things do just work now). [1] https://github.com/intel-analytics/ipex-llm [2] https://github.com/intel/intel-extension-for-pytorch [3]…
    comment by lhl · 2024-12-04 · in Intel announces Arc B-series "Battlemage" discrete graphics with Linux support
  11. Any performance benchmark against intel's 'IPEX-LLM'[0] or others? [0] - https://github.com/intel-analytics/ipex-llm
    comment by DrNosferatu · 2024-04-03 · in LLaMA now goes faster on CPUs