Pular para o conteúdo
← Back to Skalablog

Published article

Strix Halo vs Mac Studio: 2.4x Bandwidth Gap

Software Engineering

Strix Halo vs Mac Studio for local AI comes down to two numbers: 256 GB/s of derived bandwidth against 614 GB/s of printed bandwidth. AMD's Ryzen AI Max+ 395 mini PCs hold 128 GB of shared LPDDR5X and run 200B-parameter open-weight models, but Apple's M5 Max Mac Studio is over twice as fast on paper. Real llama.cpp tests show that ratio only shows up on dense models, not mixture-of-experts ones.

Strix Halo vs Mac Studio for Local AI: The Short Answer

Strix Halo vs Mac Studio for local AI has no single winner. AMD's Ryzen AI Max+ 395 boxes are cheaper per gigabyte of unified memory and run mixture-of-experts (MoE) models at roughly four fifths of Apple's speed, while Mac Studio ships more memory bandwidth and wins dense inference by 2.26x in the only independent llama.cpp roundup available.

Three facts decide the purchase. AMD's Ryzen AI Max+ 395 shares one LPDDR5X pool of up to 128 GB across 16 Zen 5 cores, a 40-core Radeon 8060S iGPU, and a neural unit rated at 50 TOPS. Apple's Mac Studio with M5 Max reaches the same 128 GB and prints 614 GB/s of memory bandwidth. Tom's Hardware measured the throughput difference between the previous-generation hardware in July 2026, and the gap depended on the model, not the spec sheet.

Why Strix Halo Exists: 128 GB of Unified Memory

Strix Halo exists because a single pool of LPDDR5X can hold open-weight models that no consumer discrete GPU can. AMD's Ryzen AI Max+ 395 tops out at 128 GB of shared memory, configurable across CPU, GPU, and neural unit, which lets a 70B or 200B model load on a desktop that is not a workstation.

Lisa Su, AMD's chief executive, presented the platform as a small AI development system capable of running 200-billion-parameter models. The chip carries 16 Zen 5 cores, a 40-core Radeon 8060S integrated GPU, and a neural processing unit rated at 50 TOPS on AMD's specification page.

The bandwidth figure that every comparison turns on is not printed by AMD. The product page lists a 256-bit memory bus and LPDDR5X-8000 as the system's maximum memory speed. Multiplying 32 bytes of bus width by 8,000 million transfers per second gives 256 GB/s, a derived ceiling rather than a signed specification.

Apple's M5 Max and M5 Ultra Bandwidth Numbers

Apple prints the bandwidth that AMD does not. The M5 Max Mac Studio is specified at 614 GB/s, and the M5 Ultra at 1.2 TB/s, both on Apple's public specifications pages. Against the derived 256 GB/s for Strix Halo, that is a ratio of about 2.4 to 1.

Memory bandwidth matters for local inference because generating one token requires reading model weights from memory. Capacity decides whether a model fits at all; bandwidth decides how many tokens per second the machine can produce. A device can hold a very large model and still generate slowly, because the weights must cross the memory bus for every token.

Apple's M5 generation was not independently benchmarked at the time of the comparison. The M5 Max Mac Studio was listed as pre-order with shipment on 22 September 2026, so every published local-inference benchmark came from the previous-generation M4 Max. Those results are a floor for Apple, not a ceiling.

What the July 2026 llama.cpp Benchmarks Actually Show

The only public llama.cpp roundup comparing these machines directly came from Tom's Hardware in late July 2026, run on the previous-generation M4 Max against an AMD Strix Halo box. Its headline conclusion was that memory bandwidth is not everything for raw local inference speed.

The measured results split by model architecture:

  • Gemma 4 12B (dense): Mac 2.26x the throughput of the AMD box.
  • GPT-OSS 120B (mixture of experts): Mac 1.6x the AMD box.
  • Qwen 3.6 35B (mixture of experts): Mac 1.25x, or a 25 percent lead.

A dense model reads every parameter for each token, so the wider Apple bandwidth gets its full 2.4-to-1 ratio. An MoE model routes only a few experts per token, so less data crosses the bus and the faster machine has less to work with. One model delivered the predicted ratio almost exactly; another delivered almost none of it.

Prices in 2026: Why the Cheap Box Stopped Being Cheap

Strix Halo's launch advantage was price. At the original entry point near $1,999, the AMD box undercut Apple's memory pricing by enough to justify the bandwidth shortfall. A global DRAM shortage erased that gap: 128 GB configurations now list around $3,500, and product pages carry notices of further increases.

Apple's side moved too. A Mac Studio configured with M5 Max, 128 GB of memory, and 1 TB of storage listed at $5,399. On the M5 Ultra pre-order page, upgrading memory from 96 GB to 256 GB added $4,000, more than three times the $1,300 Apple charged for additional CPU and GPU cores on the same page. A fully configured 256 GB machine reached $9,499. Apple's store also listed a 512 GB M5 Ultra option as arriving in late October 2026.

The two sides are compared on the same dimensions below.

MachineMemoryBandwidthApprox. priceStatus
GMKtec EVO-X2 (Strix Halo)128 GB256 GB/s derived~$3,500Shipping
Framework Desktop (Strix Halo)128 GB256 GB/s derived~£3,449Shipping
AMD Ryzen AI Halo128 GB256 GB/s derived~$3,999Shipping
Mac Studio M5 Max128 GB614 GB/s printed~$5,399Pre-order, ships 22 Sep 2026
Mac Studio M5 Ultra256 GB1.2 TB/s printed~$9,499Pre-order, 512 GB late Oct 2026

Dense vs Mixture-of-Experts: Where Strix Halo Threatens the Mac

Workload decides the ranking. On MoE models the AMD box delivers roughly four fifths of the Mac's token throughput, close enough that price and power draw become the deciding factors. On dense models it gives up more than half its speed, which is the worst case for this hardware.

The mechanism is the read pattern. Dense inference drags every weight through the memory bus for every token, so bandwidth scales almost linearly with throughput. MoE inference activates a small fraction of experts per token, so the total bytes read per token falls and bandwidth stops being the binding constraint.

A practical decision list for the choice:

  1. If your models are MoE (Qwen, GPT-OSS-style architectures), Strix Halo is competitive on speed and cheaper on price.

2. If your models are dense, the Mac's bandwidth lead is close to the full specification ratio.

3. If you paste long documents, prompt processing is arithmetic-bound rather than bandwidth-bound, and the Mac's advantage narrows further.

4. If image generation matters, the AMD Radeon 8060S beat the tested Mac in the same round of benchmarks.

Power Draw and Workstation Performance

Power draw favors AMD. The Ryzen AI Max+ 395 defaults to 55 W and can be configured to 120 W, while Apple rates the new Mac Studio at a maximum continuous draw of 480 W. A homelab owner running a 35B model on the AMD box reported staying under 100 W with a 153,000-token live context.

As a general workstation, the tested Mac led on CPU work: 27 percent ahead in single-core tasks and 21 percent across all cores. Compiling the inference engine from source took the Mac about 37 seconds, roughly 33 to 37 percent faster than the AMD machine. That is a separate purchase from being a better token generator.

Image generation inverted the ranking. In the same tests, generating a set of images took longer on the Mac Studio than on the AMD box's Radeon graphics. The default workflow would not run on the Mac at first because its GPU lacks hardware support for the 8-bit floating point format the pipeline uses, forcing a larger, slower format.

What Changes Next for Local AI Hardware

Both vendors are chasing the same scarce component, and that makes today's ranking temporary. AMD is preparing a Ryzen AI Max 400 series that raises the memory ceiling to 192 GB, and Framework has already advertised the upcoming version. Apple's 512 GB M5 Ultra option was listed for late October 2026.

The memory market drives both roadmaps. TrendForce revised its first-quarter memory contract price forecast upward by 90 to 95 percent over the previous quarter, and the transcript's comparisons between AMD's launch pricing and 2026 pricing track that movement rather than any change in either company's hardware.

For buyers, the safe conclusion is narrow: the bandwidth derived from AMD's published bus and memory-speed figures is real, but it is a ceiling rather than a delivered rate, and no M5-generation local-inference benchmark existed at the time of writing.

FAQ

  • Can AMD's Strix Halo mini PC replace a Mac Studio for local AI? It can for mixture-of-experts models, where it delivers roughly four fifths of the Mac's throughput at a lower price, but not for dense models, where the Mac leads by 2.26x in the July 2026 llama.cpp tests.
  • How much memory bandwidth does Strix Halo have? AMD prints no bandwidth figure. Its published 256-bit bus and LPDDR5X-8000 memory speed multiply to 256 GB/s, a derived ceiling rather than a signed specification.
  • How fast is the M5 Max Mac Studio? Apple specifies 614 GB/s for the M5 Max and 1.2 TB/s for the M5 Ultra. No independent local-inference benchmark of the M5 generation existed at the time of writing.
  • Why does the Mac lead more on some models than others? Dense models read every parameter per token, so bandwidth dominates. Mixture-of-experts models activate only a few experts per token, so less data crosses the bus.
  • Is the Mac Studio faster at prompt processing? Not clearly. Reading a long prompt is arithmetic-bound rather than bandwidth-bound, and the tested Mac's prompt processing was roughly in line with the AMD box, and slightly worse in places.
  • Which machine wins on image generation? The AMD Radeon 8060S was faster than the tested Mac in the same round of benchmarks, partly because the Mac's GPU lacked hardware support for the default 8-bit floating point workflow.
  • Why did Strix Halo prices rise? A global DRAM shortage pushed 128 GB configurations from launch pricing near $1,999 to around $3,500, and product pages warned of further increases.
  • How much does Apple charge for memory upgrades? On the M5 Ultra pre-order page, moving from 96 GB to 256 GB added $4,000, against $1,300 for additional CPU and GPU cores.
  • What is coming next? AMD's Ryzen AI Max 400 series raises the memory ceiling to 192 GB, and Apple listed a 512 GB M5 Ultra option for late October 2026.

Source video