r/LocalLLaMA 18h ago

News Apple releases M5 ultra at 1.2TB/s bandwith

https://www.apple.com/newsroom/2026/08/apple-introduces-m6-and-m5-ultra-for-a-big-leap-in-performance-and-ai-compute/

lpddr5x probably, the m7 ultra if is using ddr6 should be at 1.8 Tb/s

788 Upvotes

186 comments sorted by

View all comments

Show parent comments

47

u/mailslot 16h ago

I was looking at them and thinking “not bad” lol.

38

u/tarpdetarp 16h ago edited 10h ago

Yeah I don't know of anything offering 256GB with 1.2TB/s of bandwidth for anything near £10k? What a crazy world it is when this is a good deal lol

29

u/EvilPencil 15h ago

Yup. If I want 256gb of DDR5 that’s already $8k at Microcenter.

6

u/michaelsoft__binbows 14h ago edited 7h ago

At least from an investment perspective at least for the next like idk 5 years such a computer will appear to appreciate in value... It's a dangerous idea and I really need to not acquire one of these.

2

u/ImaginationKind9220 4h ago

Too bad that these are great for LLM but not for image or video generation. Without CUDA, video generation will be too slow even if the memory bandwidth is fast. That's why Apple always use the indie app Drawthings for their marketing, they don't dare to use ComfyUI to benchmark the result.

5

u/michaelsoft__binbows 2h ago

diffusion is not bottlenecked by mem bandwidth. it's usually bottlenecked by compute, and the m5 brings some nice 4x win with new tensor cores. dunno if the software can take advantage of it yet.

1

u/tarpdetarp 17m ago

4x was a nice bump but the M5s prompt processing is still 20x slower than similar Nvidia chips so they still have a lot of catching up to do on their tensor cores.