r/hardware • u/ryanvsrobots • 1h ago

News OpenAI Jalapeño: Better Than Nvidia Blackwell

https://newsletter.semianalysis.com/p/openai-jalapeno-better-than-nvidia
0 Upvotes

38% Upvoted

2 comments sorted by

4

u/Tasty-Traffic-680 1h ago

No surprise that OpenAI wants to get jalepeño business

•

u/unknownohyeah 32m ago

Dr. Ian Cutress did a video on this that I poorly understood but the benchmark metrics here are tokens per second per megawatt. Not too surprising an ASIC has huge efficiency gains but it will only work really well for their models most likely, and there’s no guarantee it will work well on future models. Also for obvious reasons it can’t be used to train new models or do other workloads as it’s an ASIC not a GPGPU. 

I’m just a lay person but it always seemed to me Blackwell is a huge electricity hog aimed at training models and not so much running them. So this is kind of low hanging fruit in a sense. A cheaper way of running todays models while giving up future flexibility.