# Unsloth Dynamic GGUFs

15 Hacker News commenters recommended Unsloth Dynamic GGUFs and 7 criticized it, November 2025 to November 2026. It was recommended in 4 of 13 months. It meets the Hacker Approved badge rule.

**Verdict:** Compressed GGUF builds of popular open models that run well on consumer hardware, with careful quality tuning. Caveat: critics say releases lack version numbers and early quants had bugs.

## Why people recommend it

- Good quality at low bit widths (3 comments): "not all layers can be 1bit - important ones are in 8bit or 16bit, and we show it still works well" ([source](https://news.ycombinator.com/item?id=47795553)) "So q6 is practically perfect, and q3 is meaningfully decent." ([source](https://news.ycombinator.com/item?id=47193482)) "they seem to work remarkably well" ([source](https://news.ycombinator.com/item?id=47197111))
- Runs well on consumer hardware (3 comments): "I would suggest using UD-IQ3_XXS for 10.9GB for 16GB machines" ([source](https://news.ycombinator.com/item?id=49367978)) "Your stuff ran LLMs extremely well on < $500 boxes" ([source](https://news.ycombinator.com/item?id=47198591)) "working pretty well so far on 4090 16gb" ([source](https://news.ycombinator.com/item?id=49366263))
- Fixes bugs and shares research (2 comments): "Your original Q4_K_XL quant was broken. Fixing bugs is great. I use your quants and appreciate your work." ([source](https://news.ycombinator.com/item?id=47198366)) "which shows SOTA on nearly all bits, and we shared all our research as well" ([source](https://news.ycombinator.com/item?id=47194281))
- Go-to source for GGUF downloads (2 comments): "your gguf are the first ones I look for when I want to download a gguf model" ([source](https://news.ycombinator.com/item?id=49366152)) "Very impressed by unsloth's team releasing the GGUF so quickly" ([source](https://news.ycombinator.com/item?id=47617095))

## What people warn about

- Early quant bugs and evasive replies (4 comments): "Your original Q4_K_XL quant was broken. Fixing bugs is great. I use your quants and appreciate your work." ([source](https://news.ycombinator.com/item?id=47198366)) "This isn't a postmortem, it's PR fluff without actually addressing the issue." ([source](https://news.ycombinator.com/item?id=47201613)) "This is a famous non-apology non-explanation of what actually happened." ([source](https://news.ycombinator.com/item?id=47240308))
- Unclear versioning and benchmark baselines (2 comments): "But those were compared against UD2.0 I guess." ([source](https://news.ycombinator.com/item?id=49374676)) "It would be nice if unsloth published GGUFs would use a version number or something" ([source](https://news.ycombinator.com/item?id=49368210))

## Alternatives hackers recommend

- [Unsloth GGUF quants](https://hackerapproved.com/p/unsloth-quants.md): 35 recommend

## Cite as

Hacker Approved, "Unsloth Dynamic GGUFs", https://hackerapproved.com/p/unsloth-dynamic-2-0-ggufs/ (counts from 1,795,640 Hacker News comments, November 2025 to November 2026).