Apple M5

“M7 comes out which is specifically designed for AI workloads”

“At typical workloads, ROI is still poor vs. current-era subsidies, but owning hardware is good for privacy/longevity/connectivity independence.”

“4x improvement made it cross the frustratingly slow barrier for me”

“Much less true since the M5 generation. Prefill, aka prompt processing, got a 4x increase.”

“after 5 minutes playing around I am thinking in getting a new one”

“4x prompt processing / prefill performance vs. M4”

“they're not beating the high end M5 chips on performance or battery life yet”

“a computer that scales down to 20 - 40% of GPU power when unplugged is an enormously significant factor”

“even the M5 laptops are consistently beat on performance and battery life by Intel Windows laptops”

“M5 is excellent, they’ve finally gotten their own tensor cores.”

“M5 with its neural execution engines and unified memory architecture present a unique local AI computing platform”

“Apple's best standard consumer CPU for computers, which would be the M5”

“half an hour to process 10k tokens on an M5 seems... not great”

“lack of wanting tinker with the core OS and wanting to use an M5”

“Neural Accelerators in M5 are already 4x faster than M4 at prefill”

“Apple will be the world's most important AI company because of these chips”

“even the M5 is not that good compared to even a 4090”

“the 2nd fastest CPU core per watt only lose out to Apple M5”

“The M5 Neural Accelerators (NAX) help a lot but at a real cost wrt. power and thermals.”

“it's pretty obvious why M5s and Mac Studios aren't replacing TPUs and GPUs”

“The M5’s massive speed up in refill is a good sign.”

“It's already greatly improved over previous generations due to M5s having tensor cores”

“MTE blocks a large chunk of vulnerabilities and makes things like rop and jop very difficult if not impossible now.”

“The performance is similar to high end dekstop consumer CPUs.”

“It's simply not possible to DIY a homelab inference server better than the M3+ for inference workloads”

“M5 is almost 2x the single core performance of the M1 Max.”

“the highest-end Apple chips (M4 Max/M5) outperform the fastest normal Ryzens in both single core and multi core tests”

“There is no non Apple desktop/server cpu with faster single core than apple m5 or even m4”

“I do believe Apple are still the fastest single-core”

“Panther Lake is barely behind the M5 chip at Cinebench.”

“The problem are all the peripherals. GPU, NPU, Display, USB, Wifi, HID, sound etc etc.”

“The core inside the M5 is faster than every other core design in single-threaded burst performance.”

“today, the M5 in the iPad Pro outperforms every chip made by EVERYONE else in the world, by 25%, at a tenth the power draw”

“the M5 appears to be an actual large leap for LLM inference with the new GPU and Neural Accelerator”

“Each core in that M3 chip is faster than the corresponding core in an x86 chip.”

“MATMUL instruction set that massively speeds up the prompt processing.”

“it has matmul instructions similar to a CUDA GPU which fixes the slow prompt processing”

“M3 is marginal now but m5 will probably make it definite.”

“Their M5 is far ahead of basically everything in single-core performance.”

“nothing beats Apple currently on single core performance”