M5 Ultra vs RTX PRO 6000

Measured comparisons of the Apple M5 Ultra and NVIDIA RTX PRO 6000 Blackwell for local LLM inference: decode, prefill, concurrency, speculative decoding, price.

M5 Ultra vs RTX PRO 6000 for LLMs: Measured, Priced

Let me set the terms first. The M5 Ultra is not an inference serving machine, and comparing it with NVIDIA serving as if it were one would be a silly exercise. This piece treats it as what it is: a personal machine, or the box behind a small shop’s handful of agents taking turns. The RTX PRO 6000 is here as the yardstick, because it is the card that tells you honestly what you give up. ...