Ollama

“people end up saying "I tried running Qwen 3.8 27b locally and it was dumb" while Ollama would default to a Q4 version of the model”

“The local LLM ecosystem doesn’t need Ollama. It needs llama.cpp. The rest is packaging, and better packaging already exists.”

“the lack of variety in quant versions, the lag between availability on Ollama, and their push to get you to use their cloud versions”

“the default one can't even reach my prompt in opencode, it's pushed out by all the pre- and post-amble”

“$20/month gives you something on par with Opus (if not better) with quotas so high I'm yet to hit.”

“A $20/month subscription to Ollama-cloud gets me good coverage of consults out to frontier models”

“Ollama cloud is also a fantastic deal. They also don't have a monthly limit, just session and weekly.”

“these run mostly on cpu as my 3080 cannot load those with more than 10gb but the cpu speed is amazing”

“Another very cost-effective option is Ollama Cloud. In a month of use, I only hit the 5-hour limit once”

“I've had a decent experience with ollama cloud. It is slower than going thru openrouter but much, much cheaper”

“Ollama makes it 1 command to run local small models, but with the newest ones there can be kinks to work out first.”

“There was this huge bug that prevented me from using a model in ollama and it took them four months for a "vendor sync"”

“I have been using GLM-5.1 with pi.dev through Ollama Cloud for my personal projects and I am very happy with this setup.”

“the impedance mismatch between when models are released and the capability of Ollama and other servers capability for use”

“The fact criticized in TFA, that the Ollama "curated" list can be misleading about the characteristics of the models, is a very serious criticism”

“I like Ollama Cloud service (I'm paid pro user), because it let me test several open source LLMs very fast”

“I also like their CLI, because it is simple to use.”

“ollama's hashed blob storage means if you've been pulling models for months, switching tools requires re-downloading everything”

“Ollama could have advertised better that llama.cpp was it's original backend, but were they obligated to?”

“It's as if Ollama is trying to create a walled garden, but the garden is outside of their property, so all it achieves”

“It makes a bunch of decisions for you so you don't have to think much to get a model up and running.”

“I'm getting some pretty fantastic results running GLM 5.1 and even Minimax 2.7 and Kimi 2.5 and Gemma 4 on Ollama's cloud instances.”

“The worst I saw - multiple parallel agents (opencode & pi-coding agents), with Kimi and glm, almost non stop development during the work day - 15-20% session consumption (I think it's 2h bucket) max. Never hit the limit.”

“Ollama usage limits insane high, no limits where to use (has normal APIs), privacy and no logging”

“Using ollama's api doesn't have the same issue, so I've stuck to using ollama for local development work.”

“they try to abstract away a bit too much, especially when LLM model quality is highly affected by a bunch of parameters”

“Ollama has had bad defaults forever (stuck on a default CTX of 2048 for like 2 years) and they typically are late to support the latest models vs llamacpp.”

“I'm using it as the backend for playing with other frontend stuff and it seems to work just fine.”

“Ollama's org had people flood various LLM/programming related Reddits and Discords and elsewhere, claiming it was an 'easy frontend for llama.cpp', and tricked people.”

“The simplest way to really start, use anything like claude code, vs code, cursor, antigratvity, (or any other IDE) ask them to install ollama”

“the value of ollama is that you can easily download and swap-out different models with the same API”

“set up Ollama + any of the generation tools here and hook them into OpenWebUI to get something pretty close to what you'd get on a cloud AI chatbox”

“The local dev instruction is to install ollama and use it to pull the models and set some env vars.”

“Core principle being your grandmother should be able to launch local AI model without needing to install 100 dependencies.”

“Ollama made the wonderful choice of trying to replicate Docker registries/layers for the model weights, so of course the models you download with Ollama cannot be easily reused”

“An 8B Ollama model installed on a middle of the road MacBook can do this effortlessly today without whirring.”

“Ollama is better than even Claude imho for just text processing but doesn't seem to have anything that can actually act on a system.”

“Ollama at its defaults with qwen3:30b-a3b has 256k context size and does ~27 tokens/sec on pure CPU”

“Ollama running locally paired occasionally with using Ollama Cloud when required is a nice option if you use it enough”

“I have twice signed up and paid $20/month for Ollama Cloud, love the service, but use it so rarely”