QUALCOMM Incorporated

Chamath support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E179 · 2024-05-17 ▶ 27:36

So I also think, Sacks, the incentive to just push towards open source in this market, if you will, is so much more meaningful than any other market.

Chamath support ×3 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E178 · 2024-05-10 ▶ 1:05:46

these models will roughly all be the same, but there's going to be a lot of scaffolding around these models that actually allow you to build these apps. So in many ways, that is like the open source movement. So even if the model itself is never open source, it doesn't much matter because you have to pay for the infrastructure.

What we're trying to do is not make the sort of smartest set of weights that we can. What we're trying to make is like this useful intelligence layer for people to use. And a model is part of that. I think we will stay pretty far ahead of, I hope, we'll stay pretty far ahead of the rest of the world on that.

Sacks support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E178 · 2024-05-10 ▶ 8:20

when Llama 3 got released, I think the big takeaway for a lot of people was, oh, wow, they've like caught up to GPT-4. I don't think it's equal in all dimensions, but it's like pretty close or pretty in the ballpark.

Jason support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E176 · 2024-04-26 ▶ 17:16

I agree with all you've said here in terms of the open source and the dramatic effect it's going to have on pricing

Friedberg support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E176 · 2024-04-26 ▶ 12:07

by open sourcing these models, they limit competition because VCs are no longer going to plow half a billion dollars into a foundational model development company. So you limit the commercial interest and the commercial value of foundational models.

Sacks support ×3 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E176 · 2024-04-26 ▶ 14:04

which they had spent billions of dollars creating in a completely open source way. And the testing on Llama 3 is that it's comparable to GPT-4. And I think this is what Chamath means by scorched earth, is that we now have a free model that's as good as GPT-4.

Chamath support ×3 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E176 · 2024-04-26 ▶ 10:00

We're seeing the economic value getting disintegrated. There is no value in foundational models economically. So then the question is who can build on top of them the fastest?

Sacks oppose ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E174 · 2024-04-12 ▶ 1:02:19

the incumbents who already have all the training data, they may have to pay a fine, there'll be some slap on the wrist, but now you've created a real moat and barrier to entry and so secretly they're going to love it. And it's going to be a big problem, I think, for the open source movement

Jason support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E171 · 2024-03-22 ▶ 51:00

I would take the top open source projects. I'd find those top contributors, take the top 20 or so open source projects and back them to the tune of significant money, 50 million, 100 million, whatever it takes

Friedberg support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E171 · 2024-03-22 ▶ 48:01

there's been a realization on how quickly foundational model development is commoditizing and how quickly costs are escalating and how many folks are chasing it.

Chamath support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E171 · 2024-03-22 ▶ 29:11

Not only are you not starting from zero, not only do you have the foundational models that are excellent and available in open source

Sacks support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E171 · 2024-03-22 ▶ 28:59

You're standing on the shoulders of the whole open source movement. All you have to do, like Chamath said, all you got to do is take the latest Mistral model

Sacks support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E169 · 2024-03-08 ▶ 1:06:15

But this isn't hard, right? I mean, all they got to do is just take the latest open source models and figure out how to customize them for their own products.

Chamath support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E168 · 2024-03-01 ▶ 1:07:20

By the way, did you guys see there was a meta demo, which I thought was really cool, which was it was run on Lama 70B, but it was a real-time translation tool, where the person was speaking in Hokkien Chinese and the other person was speaking in English and they were able to understand each other.

Sacks support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E168 · 2024-03-01 ▶ 1:02:58

Well, so what Zuck said on the last Meta call is the reason we open source everything is because we don't directly sell AI. We create products that AI makes better. So by open sourcing this, we allow the community to advance the ball and we get to reincorporate those changes. So it's a very smart strategy for companies that aren't directly selling the AI.

Friedberg support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E167 · 2024-02-23 ▶ 56:22

eventually everyone will find something that they don't want or that they're not expecting, and they're going to say, I don't want to use this product anymore. And so it is actually an opportunity for many models to proliferate, for open source to win.

Jason support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E167 · 2024-02-23 ▶ 56:08

People are just not going to want a model that has all this baked in weird bias. They're going to want something that's open source.

Friedberg support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E166 · 2024-02-16 ▶ 27:47

these models are getting chopped up in a way that you can run small models in a highly trained way locally, and you don't need a massive general purpose model

Sacks oppose ×3 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E165 · 2024-02-09 ▶ 49:47

Most of the tests show that OpenAI is still ahead of the open source models. I think even people in the open source movement will tell you that OpenAI is, call it six months ahead... Nonetheless, if OpenAI just maintains a little bit of a lead over open source, then it could... It could basically win the vast majority of the call it consumer search or consumer GPT market.

Chamath support ×3 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E165 · 2024-02-09 ▶ 42:14

I think foundational models will have no economic value. I think that they will be an incredibly powerful part of the substrate, and they will be broadly available and entirely free... But I think open source models will basically crush the value of models to zero economically, even though the utility will go to infinity, the economic value will go to zero.

Friedberg support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E159 · 2023-12-29 ▶ 58:35

My best new tech of this year, I think, is really important as we race to keep the promise of AI alive in the face of increasing government regulation, which is open source, locally run LLMs.

Chamath support ×3 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E156 · 2023-12-08 ▶ 1:08:38

There's going to be a proliferation of foundational models. The cost of those models will go to zero.

Friedberg support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E152 · 2023-11-03 ▶ 59:27

And by the way, Lama 2 is out there. Hardware is out there. All the tooling is out there for others to start to get well ahead.

Chamath support ×2 ▲ on 🤖 Open-source models commoditize the model layer and move to the edge E152 · 2023-11-03 ▶ 1:04:37

Yeah, before I give all the credit to Facebook, I'd rather say that I think there are a lot of open source alternatives, including Mistral, that I think are much better.