# Tiny-vLLM

11 Hacker News commenters recommended Tiny-vLLM and 1 criticized it, November 2025 to November 2026. It was recommended in 4 of 13 months. It meets the Hacker Approved badge rule.

**Verdict:** A small, readable C++ and CUDA LLM inference engine that people use to learn how inference works and to teach it. Some find the documentation dense in places.

## Why people recommend it

- Clear, well-documented walkthrough of inference (3 comments): "Breaking down LLM inference into digestible steps makes the codebase approachable" ([source](https://news.ycombinator.com/item?id=48331721)) "Looks interesting, it reminds me of the first llama.cpp, but better documented." ([source](https://news.ycombinator.com/item?id=48329707)) "Genuinely one of the clearest walkthrough of inference internals." ([source](https://news.ycombinator.com/item?id=48363579))
- Amazing documentation in lesson format (3 comments): "The documentation is amazing. I'm using it as a resource for a university course I'm teaching." ([source](https://news.ycombinator.com/item?id=49222724)) "I love the documentation formatted in lessons." ([source](https://news.ycombinator.com/item?id=48328953)) "The documentation is amazing." ([source](https://news.ycombinator.com/item?id=49212313))
- Teaches inference better than alternatives (3 comments): "I feel like I learned twice as much in 10 minutes reading this than I did reading LLM for Dummies" ([source](https://news.ycombinator.com/item?id=48333867)) "much shorter and not that deep as this one, for anyone interested in topic you might like it too" ([source](https://news.ycombinator.com/item?id=47676811)) "I wrote it to help others build useful mental model to be able to recreate the project yourself" ([source](https://news.ycombinator.com/item?id=48328913))

## What people warn about

- Documentation dense for some readers (1 comments): "it's a bit dense though, some schemas will help i think" ([source](https://news.ycombinator.com/item?id=48355439))

## Alternatives hackers recommend

- [MTPLX](https://hackerapproved.com/p/mtplx.md): 15 recommend
- [ONNX Runtime](https://hackerapproved.com/p/onnx-runtime.md): 11 recommend
- [OpenVINO](https://hackerapproved.com/p/openvino.md): 10 recommend
- [ONNX](https://hackerapproved.com/p/onnx.md): 9 recommend
- [Timber](https://hackerapproved.com/p/timber.md): 9 recommend

## Cite as

Hacker Approved, "Tiny-vLLM", https://hackerapproved.com/p/tiny-vllm/ (counts from 1,795,640 Hacker News comments, November 2025 to November 2026).