OpenVINO
Hacker ApprovedRanked 15 of 27 inference engines by recommenders
People recommend it for fast local AI inference on Intel CPUs and iGPUs, with easy ONNX conversion. Caveat: GPU support can be unreliable for some users.
People recommend it for fast local AI inference on Intel CPUs and iGPUs, with easy ONNX conversion. Caveat: GPU support can be unreliable for some users.
12 people gave an opinion
- recommend it
- 10
- criticize it
- 2
- approval share
- 83%
Recommended in 7 of 13 months
- November 2025: not recommended
- December 2025: not recommended
- January 2026: not recommended
- February 2026: recommended
- March 2026: recommended
- April 2026: recommended
- May 2026: not recommended
- June 2026: recommended
- July 2026: recommended
- August 2026: recommended
- September 2026: not recommended
- October 2026: recommended
- November 2026: not recommended (month in progress)
Why it carries the badge
- 10 people recommend itNeeds 10 or more, met.
- 5 recommenders for every criticNeeds 2 to 1 or better, met.
- Recommended in 7 of 13 monthsNeeds 4 or more, met.
The same three rules apply to every product, and the badge can’t be bought. How the badge works
What people say about it
The reasons people give, with the number of comments that give each one. Open a reason to read what they said.
Why people recommend it
Each mark is one comment
Fast inference on Intel hardware
“It's quite amazing the inference speed you can get from CPUs that most people would assume are running on a GPU.”
Comment from 3 Jul 2026 in “14× faster embeddings: how we rebuilt the ONNX path in Manticore” “run the images through an OpenVINO model running on the iGPU”
Comment from 4 Aug 2026 in “FFmpeg 9.0” “the performance through their tools is really good”
Comment from 12 Jun 2026 in “Ask HN: What computer are you using for AI coding tools?” - Comment from 20 Mar 2026 in “MacBook M5 Pro and Qwen3.5 = Local AI Security System”
Works well with supported models
“OpenVINO supports this really well on Intel CPUs, and converting an ONNX model to OpenVINO is straightforward.”
Comment from 3 Jul 2026 in “14× faster embeddings: how we rebuilt the ONNX path in Manticore” “Using OpenVINO and a supported model can get you surprisingly far”
Comment from 4 Jul 2026 in “Ask HN: Is anyone experimenting with different ways of using LLMs for coding?” Improving steadily over time
“OpenVINO has come a longggggg way”
Comment from 2 Oct 2026 in “Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia” “positively surprised by OpenVINO”
Comment from 9 Aug 2026 in “Ask HN: What are you working on? (August 2026)”
Other inference engines people recommend
The four most recommended other inference engines, with the same counts for each, so you can compare like for like. The tick on each bar marks the 2 to 1 line the badge needs.
| Product | Recommend | Criticize | Approval | Months | Owned | Badge |
|---|---|---|---|---|---|---|
| vLLM | 112 | 56 | 67% | 12 | — | Approved |
| Strata | 31 | 15 | 67% | 5 | — | Approved |
| DwarfStar 4 | 26 | 2 | 93% | 6 | — | Approved |
| SGLang | 19 | 13 | 59% | 8 | — | — |
| OpenVINOThis page | 10 | 2 | 83% | 7 | — | Approved |
What people said
All 12 comments that mention it, newest first. Each links to the original comment.
“OpenVINO has come a longggggg way”
“never got OpenVINO/GPU to compute correctly”
“positively surprised by OpenVINO”
“run the images through an OpenVINO model running on the iGPU”
“Using OpenVINO and a supported model can get you surprisingly far”
“It's quite amazing the inference speed you can get from CPUs that most people would assume are running on a GPU.”
“OpenVINO supports this really well on Intel CPUs, and converting an ONNX model to OpenVINO is straightforward.”
“the performance through their tools is really good”
“fairly good software support and APIs”
“try OpenVino on a cheap Intel N100 CPU”
“these companies will name their products OpenShell or OpenVINO or whatever with the implication that anyone else will ever contribute”
“it's easier to use local AI models with OpenVINO than it is to figure out how to use the Apple NPU's”
Counts come from 1,795,640 Hacker News comments, November 2025 to November 2026. How we count. Report a mistake.