E116

E116: Toxic out-of-control trains, regulators, and AI

2023-02-17 spoken.md · speaker-labeled ▶ watch ← E115 all episodes E118 →

3
ideas born
9
ideas moved
24
captures · 4 voices
5
dissenting
+173.0
conviction added
-129.7
decay · 116 silent

Every number here is replayed from score_events — the same ledger the pool ranks on. Decay is what the 116 ideas nobody mentioned gave up this week; it applies only when an episode is processed.

Tier crossings

conviction thresholds crossed by this episode — 65 / 45 / 15 · ideas born here show where they landed. why 65 isn't always green

▲ +24.4 🏛️ Section 230's algorithmic shield gets rolled back - platform liability overhang watch green threshold 52.8 → 77.2 still ember — green gate not met
▲ +18.5 🤖 OpenAI is 2023's biggest winner — Microsoft deal inevitable ember watch 44.5 → 63.0
▲ +57.8 🏛️ The AI trust-and-safety layer is the next censorship war born at watch 57.8
▼ -15.2 🤖 Natural-language chat disrupts Google's search box green threshold watch 67.9 → 52.7
▲ +40.4 🏛️ East Palestine forces rail safety re-regulation and operator liability born at ember 40.4
▲ +40.3 📈 Zantac carcinogen cover-up becomes a pharma liability reckoning born at ember 40.3
▼ -16.1 🤖 Foundation models are a big-tech oligopoly - the substrate gets given away watch ember 53.0 → 36.9

Who moved the board

each voice's force on conviction this episodesupports and opposes, weighted exactly as the replay applied them · share = % of this episode's movement

Chamath
Chamath
6 captures · 33% of movement · 2 ideas born
+89.1 / -10.8 → net +78.3
Sacks
Sacks
7 captures · 31% of movement · 1 idea born
+93.1 → net +93.1
Friedberg
Friedberg
5 captures · 19% of movement
+17.0 / -39.6 → net -22.7
Jason
Jason
6 captures · 18% of movement
+39.4 / -15.2 → net +24.3

What got argued (9 ideas)

ordered by how hard each idea moved · quotes are verbatim from the transcript, timestamps deep-link into the episode

NEW MSFT 🏛️ The AI trust-and-safety layer is the next censorship war closed 23 CONTESTED ▲ +57.8 -0.0 → 57.8

Consumer AI products are not raw models: a human-programmed trust-and-safety layer intercepts the prompt and decides whether the model's real answer ships. Sacks' claim is that this layer carries the monoculture bias of a handful of companies, that they cannot see it and will not hand users a filter, and that it is a godlike power to reprogram what people learn - so the model providers inherit social media's censorship war as a reputational and eventual regulatory overhang. Friedberg and Chamath argue it is a routine media editorialization cycle that resolves itself as models fragment by audience.

plays MSFT ·primary GOOGL evals 2024-02-17
Chamath
Chamath support ×2 sentiment ▶ 1:12:47
Well, to your point, I think that is the big existential risk with this entire part of computer science, which is why I think it's actually a very bad business decision for corporations to view this as a canonical expression of a product.
Friedberg
Friedberg oppose ×3 explicit_prediction ▶ 1:13:43
There are always these cycles where initially it feels like the envelope goes too far. There's a retreat. There's a government intervention. There's a censorship cycle.
Jason
Jason support ×3 sentiment ▶ 1:19:52
And this filtering, and then it's giving different answers to different people about the same prompt. So this is what people are doing right now is trying to figure out, as you're saying, Sacks, what did they put into this? And who is making these decisions?
Sacks
Sacks support ×3 explicit_prediction ▶ 1:22:03
But then, for a few small percent of the queries that could be controversial, it's going to give you an answer, and you're not even going to know what the bias is.
NEW NSC 🏛️ East Palestine forces rail safety re-regulation and operator liability closed 7 CONTESTED ▲ +40.4 0.0 → 40.4

The East Palestine vinyl-chloride derailment is traced to the 2017 rollback of rail safety standards that let the railroads skip ECP brake upgrades after heavy industry lobbying. Sacks and Chamath argue the law gets rewritten and the operators get punished monetarily, so the Class I railroads carry a compliance-capex, liability and political overhang. Friedberg takes the other side: hauling hazardous chemicals is load-bearing for the economy, the accident rate is tolerable, and there is only so much safety you can bolt on.

plays NSC ·primary CSX UNP evals 2024-02-17
Sacks
Sacks support ×3 sentiment ▶ 17:25
Apparently, Congress back in 2017 passed deregulation of safety standards around these train companies so that they didn't have to spend the money to upgrade the brakes that supposedly failed, that caused it.
Friedberg
Friedberg oppose ×3 sentiment ▶ 19:35
And there are these occasional bad things that happen. Maybe you can add more kind of safety features, but at some point, you can only do so much.
Chamath
Chamath support ×2 explicit_prediction ▶ 20:46
What was the structures of government or corporations that failed, and how do you either rewrite the law or punish these guys monetarily so that this kind of stuff doesn't happen again?
NEW GSK 📈 Zantac carcinogen cover-up becomes a pharma liability reckoning closed 7 ▲ +40.3 0.0 → 40.3

Chamath's claim, off the near-zero media coverage: Glaxo sold Zantac over the counter to tens of millions of people for forty years while knowing it carried a cancer risk, and that gets uncovered and punished monetarily. Bearish the Zantac defendants on litigation and reputational liability.

plays GSK ·primary SNY evals 2024-02-17
Friedberg
Friedberg support ×1 sentiment ▶ 16:38
Yeah, 40 years they knew that there was cancer risk.
Chamath
Chamath support ×2 explicit_prediction ▶ 20:46
I think we're going to figure out how did Glaxo, how are they able to cover up a cancer-causing carcinogen sold over-the-counter via this product called Zantac, which tens of millions of people around the world took for 40 years, but now it looks like causes cancer, how are they able to cover that up for 40 years?
GOOGL 🏛️ Section 230's algorithmic shield gets rolled back - platform liability overhang closed 32 ▲ +24.4 52.8 → 77.2
Friedberg
Friedberg support ×2 explicit_prediction ▶ 35:53
There's going to be content restrictions driven by the owners and operators of the algorithm because of pressure they're going to get from shareholders and others.
Sacks
Sacks support ×3 explicit_prediction ▶ 38:51
I'm worried that the conservatives on the Supreme Court are going to make the same mistake as conservative media has been making, which is to dramatically rein in or limit Section 230 protection, and it's going to blow up in our collective faces.
Jason
Jason support ×3 explicit_prediction ▶ 43:25
That's the algorithm, replaced editors and did it better. And so, I think that section 230 really does need to be rewritten.
Chamath
Chamath support ×3 explicit_prediction ▶ 46:10
Look, somebody at this big tech company wrote an algorithm that is a weighing function that caused this objectionable content to rise to the top.
MSFT 🤖 OpenAI is 2023's biggest winner — Microsoft deal inevitable closed 32 CONTESTED ▲ +18.5 44.5 → 63.0
Jason
Jason support ×2 sentiment ▶ 1:06:33
They only released it when Sam Altman in his brilliance got Microsoft to integrate this immediately and see it as a competitive advantage.
Sacks
Sacks support ×3 explicit_prediction ▶ 1:08:54
I mean, GPT-4 is coming out, I think, in the next several months, and it's supposedly, you know, a huge advancement over version 3 So, I think that a lot of these holes in the capabilities are getting fixed, and the AI is only going one direction, Jason, which is more and more powerful.
MSFT 🤖 Foundation models are a big-tech oligopoly - the substrate gets given away closed 30 CONTESTED ▼ -16.1 53.0 → 36.9
Chamath
Chamath oppose ×2 explicit_prediction ▶ 1:05:35
I think that you'll see the emergence of these various models that are actually optimized for various ways of thinking or political leanings.
Friedberg
Friedberg oppose ×3 explicit_prediction ▶ 1:16:06
And you know, as LLMs aren't right now, they feel like they're this monopoly held by Google and held by Microsoft and OpenAI. I think very quickly, like all technologies, they will commoditize.
Sacks
Sacks support ×3 sentiment ▶ 1:24:57
The market has not resolved to the right answer with all the other big tech problems because they're monopolies.
GOOGL 🤖 Natural-language chat disrupts Google's search box closed 0 CONTESTED ▼ -15.2 67.9 → 52.7
Jason
Jason oppose ×3 explicit_prediction ▶ 1:06:59
This stuff is not ready for prime time. It's a bit of a parlor trick right now. And I think it's going to blow up in people's faces and their reputations are going to get damaged by it
META 🏛️ US antitrust is punitive politics, not competition policy - hot-button platforms carry the overhang closed 78 ▲ +12.3 71.2 → 83.5
Chamath
Chamath support ×3 sentiment ▶ 25:25
Amazon and Roomba, Facebook and this exercise app, but all of this other stuff goes completely unchecked. And I think that that is probably emblematic of what many of these government institutions are being run like.
Sacks
Sacks support ×3 sentiment ▶ 27:54
what Lina Khan has done is just go after quote bigness, which just means stopping these companies from doing anything that would make them bigger. The approach is just not surgical enough.
Jason
Jason support ×2 sentiment ▶ 29:48
Being a billionaire is the crime. Having great success is the crime. When in fact, the crime is much more subtle.
NYT 📈 Legacy journalism is obsolete - the opinion economy takes the audience closed 60 ▲ +10.5 65.7 → 76.2
Jason
Jason support ×3 sentiment ▶ 15:01
But now it's become, I think, where a lot of Americans are by default saying, let me read the substacks, TikToks and Twitter before I trust the New York Times.
Sacks
Sacks support ×3 sentiment ▶ 23:25
So I think this is partly a media story where the media, quite simply, is agenda driven. And if a true disaster happens that doesn't fit with their agenda, they're simply going to ignore it.

Episode digest

written during extraction and stored in data/extractions/ep116.json — the auditable source of truth, including everything market-adjacent that did not earn a capture

Diarization is CLEAN (Jason 93 / Sacks 79 / Friedberg 73 / Chamath 61; every addressed-by-name handoff resolves correctly, fingerprints check out - Friedberg's TPB science corner, Sacks' distributor-vs-publisher law, Jason's moderator sign-off; the seven apparent time gaps are all long monologues, no holes). Three new ideas: the East Palestine derailment as a rail re-regulation and operator-liability thesis (Sacks blames the 2017 lobbied-for safety rollback, Chamath wants the law rewritten or the operators fined, Friedberg openly takes the other side that hazmat rail risk is the price of a working economy), the AI trust-and-safety layer as the next censorship war (Sacks table-pounding that a human-programmed filter with an invisible monoculture bias is 'godlike, totalitarian power', against Friedberg's Gutenberg-to-radio editorialization cycle and Chamath's fragmentation fix), and Chamath's Glaxo/Zantac carcinogen cover-up as a pharma liability call. Heavily reinforced: Lina Khan's FTC as punitive-not-principled antitrust (all three talkers, off the Christine Wilson resignation) and the Section 230 algorithmic-shield rollback, where Sacks now predicts a conservative SCOTUS guts 230 and produces MORE censorship, and Friedberg - the standing dissenter at E099 and E107 - concedes platforms will inevitably be forced to carry editorial responsibility. Trashed: Jason calls the week-old Bing and Bard products 'a bit of a parlor trick', not ready for prime time, with wrong facts on a basic query - an oppose on chat-AI search disruption while Sacks goes the other way on capability (GPT-4 imminent, 'the AI is only going one direction'). Watch the oligopoly idea: Chamath co-proposed it five weeks earlier at E111 and here argues unconstrained startups will ship differentiated models and beat the brittle-RLHF incumbents, logged as oppose rather than reversal because his mechanism (fine-tuned models by political leaning) is arguably still the app layer the E111 thesis predicts.