intel

intel-extension-for-pytorch

Python2022–2025

intel / intel-extension-for-pytorch · Archived

intel-extension-for-pytorch

A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

Explore on GitHub Read Hacker News discussions

9Distinct people

10Mentions

0Explicit recommenders

2KGitHub stars

REPOSITORY AT A GLANCE

What to know before exploring

What it is

A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by year10 dated mentions

Observed mentions: 2022-10-29 02:47:43 UTC to 2025-09-23 04:21:46 UTC.

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges

UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
Period	Start (UTC)	End (exclusive, UTC)	Mentions	Submissions	Comments
2022	2022-01-01 00:00:00 UTC	2023-01-01 00:00:00 UTC	1	0	1
2023	2023-01-01 00:00:00 UTC	2024-01-01 00:00:00 UTC	3	0	3
2024	2024-01-01 00:00:00 UTC	2025-01-01 00:00:00 UTC	5	1	4
2025	2025-01-01 00:00:00 UTC	2026-01-01 00:00:00 UTC	1	0	1

What Hacker News says

10 sources

sandGorgon·Sep 23, 2025

you folks should really try the lenovo yoga series. especially this year's yoga slim aura edition (which has the intel lunar lake chips). The ipex-llm extensions are fairly stable and work very well ( https://github.com/intel/intel-extension-for-pytorch ) and the build quality of the laptop is exactly like the macbook air - i have both.

In I'm spoiled by Apple Silicon but still love Framework

lhl·Dec 4, 2024

Recently I did some testing of the IPEX-LLM llama.cpp backend on LNL's Xe2: https://www.reddit.com/r/LocalLLaMA/comments/1gheslj/testing... Based on scaling by XMX/engine clock napkin math, the B580 should have 230 FP16 TFLOPS and 456 GB/s MBW theoretical. At similar efficiency to LNL Xe2, that should be about pp512 ~4700 t/s and tg128 ~77 t/s for a 7B class model. This would be about 75% of a 3090 for pp and 50% for tg (and of course, 50% of memory). For $250, that's not too bad. I do want to note a couple things from my poking around. The IPEX-LLM [1] was very responsive, and was able to address an issue I had w/ llama.cpp within days. They are doing weekly update releases, so that's great. The IPEX stands for Intel Extension for PyTorch [2] and it is a mostly drop-in for PyTorch: "Intel® Extension for PyTorch* extends PyTorch* with up-

Read the rest

to-date features optimizations for an extra performance boost on Intel hardware. Optimizations take advantage of Intel® Advanced Vector Extensions 512 (Intel® AVX-512) Vector Neural Network Instructions (VNNI) and Intel® Advanced Matrix Extensions (Intel® AMX) on Intel CPUs as well as Intel Xe Matrix Extensions (XMX) AI engines on Intel discrete GPUs. Moreover, Intel® Extension for PyTorch* provides easy GPU acceleration for Intel discrete GPUs through the PyTorch* xpu device." All of this depends on Intel oneAPI Base Kit [3] which has easy Linux (and presumably Windows) support. I am normally an AUR guy on my Arch Linux workstation, but those are basically broken and I had much more success installing oneAPI Base Kit (w/o issues) directly in Arch Linux. Sadly, this is also where there are issues some of the code is either dependent on older versions of oneAPI Base Kit that are no longer available (vLLM requires oneAPI Base Toolkit 2024.1 - this is not available for download from the Intel site anymore) or in dependency hell (GPU whisper simply will not work, ipex-llm[xpu] has internal conflicts from the get go), so it's not all sunshine. On average, ROCm w/ RNDA3 is much more mature (while not always the fastest, most basic things do just work now). [1] https://github.com/intel-analytics/ipex-llm [2] https://github.com/intel/intel-extension-for-pytorch [3] https://www.intel.com/content/www/us/en/developer/tools/onea...

In Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

pineapple_sauce·Dec 4, 2024

https://github.com/intel/intel-extension-for-pytorch

In Intel announces Arc B-series "Battlemage" discrete graphics with Linux support

aconz2·May 7, 2024

I have been playing around in pytorch with an a770 16GB card and hit this error. The response seems to be https://github.com/intel/intel-extension-for-pytorch/issues/... that larger than 4gb allocations aren't supported even though the card is 16gb. I haven't seen a ton of stuff on intel arc for machine learning so wanted to share my experience

In Intel Arc A770: Arrays larger than 4GB crashes

aconz2·May 7, 2024Submission

Intel Arc A770: Arrays larger than 4GB crashes

14 points · Open discussion

spearman·Jan 20, 2024

OK I found it. Looks like they use SYCL (which for some reason they've rebranded to DPC++): https://github.com/intel/intel-extension-for-pytorch/tree/v2...

In Efficient LLM inference solution on Intel GPU

singhrac·Dec 14, 2023

Just to point out it does, kind of: https://github.com/intel/intel-extension-for-pytorch I've asked before if they'll merge it back into PyTorch main and include it in the CI, not sure if they've done that yet. In this case I think the biggest bottleneck is just that they don't have a fast enough card that can compete with having a 3090 or an A100. And Gaudi is stuck on a different software platform which doesn't seem as flexible as an A100.

In Intel CEO: 'The entire industry is motivated to eliminate the CUDA market'

ColonelPhantom·Aug 6, 2023

Intel already has a working GPGPU stack, using oneAPI/SYCL. They also have arguably pretty good OpenCL support, as well as downstream support for PyTorch and Tensorflow using their custom extensions https://github.com/intel/intel-extension-for-tensorflow and https://github.com/intel/intel-extension-for-pytorch which are actively developed and just recently brought up-to-date with upstream releases.

In Intel Arc A580 could be the next great affordable GPU

westurner·May 14, 2023

https://github.com/intel/intel-extension-for-pytorch : > Intel® Extension for PyTorch extends PyTorch with up-to-date features optimizations for an extra performance boost on Intel hardware. Optimizations take advantage of AVX-512 Vector Neural Network Instructions (AVX512 VNNI) and Intel® Advanced Matrix Extensions (Intel® AMX) on Intel CPUs as well as Intel Xe Matrix Extensions (XMX) AI engines on Intel discrete GPUs. Moreover, through PyTorch xpu device, Intel® Extension for PyTorch provides easy GPU acceleration for Intel discrete GPUs with PyTorch https://pytorch.org/blog/celebrate-pytorch-2.0/ (2023) : > As part of the PyTorch 2.0 compilation stack, TorchInductor CPU backend optimization brings notable performance improvements via graph compilation over the PyTorch eager mode. > The TorchInductor CPU backend is sped up by leveraging

Read the rest

the technologies from the Intel® Extension for PyTorch for Conv/GEMM ops with post-op fusion and weight prepacking, and PyTorch ATen CPU kernels for memory-bound ops with explicit vectorization on top of OpenMP-based thread parallelization DLRS Deep Learning Reference Stack: https://intel.github.io/stacks/dlrs/index.html

In Run Llama 13B with a 6GB graphics card

learndeeply·Oct 29, 2022

https://github.com/intel/intel-extension-for-pytorch PyTorch version. Looks like it's been supported a lot longer than TensorFlow, the repo dates back over a year.

In Intel Extension for TensorFlow