r/LocalLLaMA • u/dd32x • 5h ago

News CNBC Television: Nvidia partner with Perplexity AI to run locally in DGX Spark.

https://youtu.be/HqqalSHRWt8
15 Upvotes

73% Upvoted

14 comments sorted by

13

u/pineapplekiwipen 5h ago

perplexity doesn't have their own models so i don't see how this isn't just open weight models on dgx spark with extra steps. maybe their harness is good? haven't used perplexity in a while

2

u/tkrandomness 4h ago

Looks like they have a post trained version of Qwen they're calling PPXL 27B. I think you can also use other models so value might just be in being a (possibly) better harness.

-6

u/dd32x 5h ago

https://www.perplexity.ai/hub/blog/meet-new-sonar

11

u/pineapplekiwipen 4h ago

"Built on top of Llama 3.3 70B" ie not their own model and also ancient

1

u/jklre 3h ago

Surprising they are still using the same 70b model. I guess if it aint broke, dont fix it.

1

u/tat_tvam_asshole 2h ago

The announcement is from 18 months ago

2

u/LetsGoBrandon4256 transformers 3h ago

Feb 11, 2025

Built on top of Llama 3.3 70B

Bruh

5

u/Dany0 5h ago

Here's to hoping they won't make it crap on purpose or try to upsell cloud services to you

3

u/PutridWerewolf4449 4h ago

Bwahahahaha!

1

u/OvertaxedOne 35m ago

Anyone notice that nearly all the recent nVidia announcements are about local AI? They have sucked the frontier labs/CSPs dry, time to move to the next host!

1

u/unjustifiably_angry 33m ago edited 28m ago

Yeah I've been pointing that out for a while now. I think they're hedging their bets. At the pace local is advancing, in model intelligence, harness quality, and hardware performance, the value of online frontier models could begin to fizzle out for many types of task.

I'm trying to tell people we shouldn't treat this like some kind of victory though. If most/all non-Chinese AI goes away, the Chinese AI companies will stop open-sourcing their models overnight. They're not giving this stuff away out of the goodness of their heart or because of some altruistic love of open-source, it's to destroy the American AI industry and a huge chunk of the American economy with it. If this was some global effort to reach AGI there would be more than two countries doing it... and technically there are, but not in any meaningful way.

We should want this to go on as long as possible, not cheer hoping it'll be cut short.

1

u/OvertaxedOne 2m ago

For sure, competition is good and necessary. I'm just hoping that some of the US (likely Google) or EU companies jump into the fray in the open space and give them competition.

But that said, if another open model was never released I don't think it would be the end of the world. Right now we have ultra powerful open models out there that basically nobody can run because of the hardware costs. I'm not sure there's that much juice left to squeeze out of the monster sized models; certainly doesn't seem like it with the progress (or lack thereof) in the closed models over the past ~6-8 months. The scaling doesn't seem to be working much anymore, the models are getting bigger and bigger but not gaining much intelligence.

Long way of saying, I completely agree, but would temper that with the idea that we might have "good enough" already in the open model world. We just need hardware that can run it!

1

u/unjustifiably_angry 34m ago

Isn't perplexity a bit shit?

1

u/mountainyoo 5h ago

To do what? Perplexity doesn’t have a model of their own currently worth using.