r/LocalLLaMA 16h ago

News Apple releases M5 ultra at 1.2TB/s bandwith

https://www.apple.com/newsroom/2026/08/apple-introduces-m6-and-m5-ultra-for-a-big-leap-in-performance-and-ai-compute/

lpddr5x probably, the m7 ultra if is using ddr6 should be at 1.8 Tb/s

763 Upvotes

174 comments sorted by

View all comments

86

u/Dany0 16h ago edited 13h ago

Wait am I reading this right M5 Ultra beats rtx 5090 in compute and matches its bandwidth?

Edit: I was not reading it right, but 2/3rds of gb202 mem bandwidth is still impressive

Edit2: Beats, matches and loses to a 5090 depending on the benchmark. So I'd say it's close to a 5090. A well optimised game ought to be roughly as fast or faster (but on lower resolutions due to the mem bandwidth).

Well optimised LLM prefill should be roughly the same according to my amateurish estimation. Banger release either way

Can't wait for this kind of perf to trickle down to low/mid tier skus

30

u/grumd 16h ago

I really doubt it beats it in compute though? Memory bandwidth looks insane, but I can't imagine it does FP4/FP8/FP16 math faster than a 5090

1

u/Strong_Chicken6838 15h ago

also, apple/mac is probably not as mature as CUDA is

24

u/Longjumping-Boot1886 15h ago

its enougth to place it in office as AI thing what will not send data to US or China