FastFlowLM
Shares rank 23 of 27 inference engines by recommenders
People recommend it as a way to run local LLMs on AMD NPUs. Critics say performance is underwhelming and it is not faster than the Ryzen 395's GPU.
People recommend it as a way to run local LLMs on AMD NPUs. Critics say performance is underwhelming and it is not faster than the Ryzen 395's GPU.
9 people gave an opinion
- recommend it
- 6
- criticize it
- 3
- approval share
- 67%
Recommended in 4 of 13 months
- November 2025: not recommended
- December 2025: not recommended
- January 2026: not recommended
- February 2026: not recommended
- March 2026: recommended
- April 2026: recommended
- May 2026: not recommended
- June 2026: recommended
- July 2026: not recommended
- August 2026: not recommended
- September 2026: not recommended
- October 2026: recommended
- November 2026: not recommended (month in progress)
Why it doesn’t carry the badge
- 6 people recommend itNeeds 10 or more, not met.
- 2 recommenders for every criticNeeds 2 to 1 or better, met.
- Recommended in 4 of 13 monthsNeeds 4 or more, met.
The same three rules apply to every product, and the badge can’t be bought. How the badge works
What people say about it
The reasons people give, with the number of comments that give each one. Open a reason to read what they said.
Why people recommend it
Each mark is one comment
Go-to option for AMD NPU
“Check out FastFlowLM for AMD NPU support.”
Comment from 14 Jun 2026 in “Linux 7.1” “FastFlowLM is what you're looking for”
Comment from 7 Oct 2026 in “Strands Decider 2B: a small, open-source, decision model”
What people warn about
Each mark is one comment
Performance is slow or underwhelming
“It is quite slow, but if you want to compute embeddings in the background it's fine.”
Comment from 19 Apr 2026 in “My first impressions on the ROCm and Strix Halo” “but the performance is underwhelming”
Comment from 2 Apr 2026 in “Lemonade by AMD: a fast and open source local LLM server using GPU and NPU”
Other inference engines people recommend
The four most recommended other inference engines, with the same counts for each, so you can compare like for like. The tick on each bar marks the 2 to 1 line the badge needs.
| Product | Recommend | Criticize | Approval | Months | Owned | Badge |
|---|---|---|---|---|---|---|
| vLLM | 112 | 56 | 67% | 12 | — | Approved |
| Strata | 31 | 15 | 67% | 5 | — | Approved |
| DwarfStar 4 | 26 | 2 | 93% | 6 | — | Approved |
| SGLang | 19 | 13 | 59% | 8 | — | — |
| FastFlowLMThis page | 6 | 3 | 67% | 4 | — | — |
What people said
8 of the 9 comments that mention it, newest first. Each links to the original comment.
“I wish they supported older gen XDNA though”
“FastFlowLM is what you're looking for”
“Check out FastFlowLM for AMD NPU support.”
“It is quite slow, but if you want to compute embeddings in the background it's fine.”
“but the performance is underwhelming”
“NPU-accelerated kernels are proprietary binaries”
“because it's not faster than the Ryzen 395's GPU”
“I posted it here the same day I found and started using it”
Counts come from 1,795,640 Hacker News comments, November 2025 to November 2026. How we count. Report a mistake.