WEBVTT

NOTE
Podcast: Logbuch:Netzpolitik
Episode: LNP504 The politics of intellectual shame
Publishing Date: 2024-10-17T02:32:15+02:00
Podcast URL: https://logbuch-netzpolitik.de
Episode URL: https://logbuch-netzpolitik.de/lnp504-the-politics-of-intellectual-shame

00:00:00.005 --> 00:00:01.325
<v Tim Pritlove>Good morning, Linus.

00:00:01.565 --> 00:00:02.325
<v Linus Neumann>Good morning, Tim.

00:00:02.985 --> 00:00:04.105
<v Tim Pritlove>Linus, what watch?

00:00:04.565 --> 00:00:05.325
<v Linus Neumann>Ten watch.

00:00:05.725 --> 00:00:06.545
<v Tim Pritlove>Such much?

00:00:06.865 --> 00:00:09.105
<v Meredith Whittaker>You'll get along beautifully in America.

00:00:30.245 --> 00:00:34.285
<v Tim Pritlove>Logbuch Netzpolitik Nummer 503 vom 16.

00:00:34.465 --> 00:00:40.545
<v Tim Pritlove>Oktober 2024 und ihr werdet es schon gemerkt haben.

00:00:41.385 --> 00:00:43.105
<v Linus Neumann>Wir sprechen eine andere Sprache.

00:00:43.585 --> 00:00:47.485
<v Tim Pritlove>Wir sprechen eine andere Sprache heute, weil wir haben heute einen Gast und

00:00:47.485 --> 00:00:52.025
<v Tim Pritlove>das ist dann ein Gespräch, was wir heute auf Englisch führen wollen.

00:00:52.285 --> 00:00:56.465
<v Linus Neumann>Bevor wir aber kurz unsere Episodennummer korrigieren, ist nämlich 504.

00:00:56.925 --> 00:00:57.645
<v Tim Pritlove>Was habe ich gesagt?

00:00:57.765 --> 00:00:58.285
<v Linus Neumann>503.

00:00:58.405 --> 00:00:58.505
<v Tim Pritlove>Oh.

00:01:01.145 --> 00:01:03.045
<v Tim Pritlove>Ja, ausnahmsweise lebe ich mal nicht in der Zukunft.

00:01:03.205 --> 00:01:04.785
<v Linus Neumann>Man merkt, wir sind aufgeregt.

00:01:06.905 --> 00:01:11.865
<v Linus Neumann>Tim hat ja einen britischen Pass und muss jetzt mal seine Britischkenntnisse unter Beweis stellen.

00:01:11.985 --> 00:01:14.325
<v Tim Pritlove>Was habe ich einen britischen Pass? Ich habe gar keinen britischen Pass, ich bin Deutscher.

00:01:14.885 --> 00:01:16.165
<v Linus Neumann>Okay, aber du hattest ja nicht einen britischen Pass.

00:01:16.205 --> 00:01:16.905
<v Tim Pritlove>Das ist aber abgelaufen.

00:01:17.065 --> 00:01:19.125
<v Linus Neumann>Achso, der ist abgelaufen. Okay, dann das erklärt einige.

00:01:20.785 --> 00:01:25.925
<v Tim Pritlove>Anyway, we say hello to Meredith. Meredith Whitaker. Hello, welcome to our podcast.

00:01:26.345 --> 00:01:28.405
<v Meredith Whittaker>I'm so happy to be here. Thank you for having me.

00:01:29.427 --> 00:01:37.187
<v Linus Neumann>Meredith, you are, in case somebody doesn't know you, the president of the Signal Foundation.

00:01:37.427 --> 00:01:38.667
<v Meredith Whittaker>I am. I am.

00:01:38.867 --> 00:01:42.467
<v Linus Neumann>And Signal is a messenger application?

00:01:42.767 --> 00:01:49.167
<v Meredith Whittaker>It is the world's most widely used, truly private messaging application.

00:01:49.647 --> 00:01:54.947
<v Meredith Whittaker>I always have to put the full sentence in there. A very special messaging application.

00:01:55.047 --> 00:01:55.787
<v Linus Neumann>What makes it special?

00:01:55.787 --> 00:01:58.847
<v Meredith Whittaker>Um we build against

00:01:58.847 --> 00:02:04.087
<v Meredith Whittaker>the grain to put it in kind of flowery language we go out of our way to build

00:02:04.087 --> 00:02:11.227
<v Meredith Whittaker>for privacy and to get as close to collecting no data at all as possible which

00:02:11.227 --> 00:02:15.967
<v Meredith Whittaker>as you and i assume many in your audience know is a lot more work.

00:02:15.967 --> 00:02:18.047
<v Linus Neumann>Than simply encrypting.

00:02:18.047 --> 00:02:22.327
<v Meredith Whittaker>Then well encrypting is part of that but then you need to make sure the encryption

00:02:22.327 --> 00:02:26.027
<v Meredith Whittaker>works and then encryption of message content is Das ist nicht möglich,

00:02:26.227 --> 00:02:30.987
<v Meredith Whittaker>weil du also hast Meta-Data. Du hast auch libraries, du hast du in.

00:02:31.107 --> 00:02:36.047
<v Meredith Whittaker>Du hast Core Services, du hast du mit. So, da ist viel ingenuity required zu

00:02:36.047 --> 00:02:43.487
<v Meredith Whittaker>actually create a system das ist rejecting den normative assumptions der Tech-Industrie heute.

00:02:43.767 --> 00:02:47.547
<v Meredith Whittaker>Wir alle wollen ein ton of Daten, und wir alle wollen monetize das Daten.

00:02:47.607 --> 00:02:52.087
<v Meredith Whittaker>Wir wollen Sie ads mit dem Daten. Wir wollen das zu anderen Kunden.

00:02:52.147 --> 00:02:55.467
<v Meredith Whittaker>Wir wollen das Daten-Broker. Wir wollen das AI-Modeln mit dem Daten.

00:02:56.747 --> 00:03:01.707
<v Meredith Whittaker>Most of the infrastructure in the tech ecosystem now assumes that as a given.

00:03:02.247 --> 00:03:04.327
<v Meredith Whittaker>And then we have to rewrite things too.

00:03:04.867 --> 00:03:10.627
<v Linus Neumann>And you negate all these assumptions and try to build a truly private messaging

00:03:10.627 --> 00:03:14.107
<v Linus Neumann>platform in a world that has a completely different business model.

00:03:14.427 --> 00:03:17.927
<v Meredith Whittaker>Yeah. Well, I'm going to just flip that to be a little bit rhetorical and say

00:03:17.927 --> 00:03:23.027
<v Meredith Whittaker>those assumptions negate the human right to private intimate communication.

00:03:23.027 --> 00:03:29.107
<v Meredith Whittaker>And we are trying to rebuild a tech ecosystem that actually honors those.

00:03:29.847 --> 00:03:31.407
<v Linus Neumann>That's an even higher goal.

00:03:31.627 --> 00:03:31.767
<v Meredith Whittaker>Yeah.

00:03:32.487 --> 00:03:38.387
<v Tim Pritlove>Before we dig more into the Signal project, which in itself I think is quite

00:03:38.387 --> 00:03:45.267
<v Tim Pritlove>interesting, we'd like to understand how did you get there, where you are right now.

00:03:45.367 --> 00:03:50.487
<v Tim Pritlove>So what was your introduction into this digital world? When did it start?

00:03:53.027 --> 00:03:58.807
<v Meredith Whittaker>I don't have one of those stories where I'm like an Atari. I was four. I'm a hacker.

00:04:01.407 --> 00:04:05.327
<v Meredith Whittaker>I didn't care about tech, qua tech. I wasn't interested.

00:04:05.567 --> 00:04:09.507
<v Meredith Whittaker>You remember back in school, there were two kinds of nerds.

00:04:10.157 --> 00:04:12.777
<v Meredith Whittaker>There were the math nerds and the book nerds.

00:04:13.177 --> 00:04:14.117
<v Linus Neumann>You were the book nerd?

00:04:14.197 --> 00:04:18.137
<v Meredith Whittaker>I was the book nerd. But in the story we tell now, because nerddom has been

00:04:18.137 --> 00:04:22.877
<v Meredith Whittaker>overlapped with monetary success and sort of a career in math and science,

00:04:22.877 --> 00:04:26.357
<v Meredith Whittaker>I think we forget about the book nerds. But hello, I'm here to remind you.

00:04:26.877 --> 00:04:29.877
<v Meredith Whittaker>We exist. We're here. And that's who I was.

00:04:30.317 --> 00:04:34.257
<v Meredith Whittaker>And so I studied literature and rhetoric at Berkeley, which I just thought were,

00:04:34.857 --> 00:04:35.817
<v Meredith Whittaker>I mean, they're still beguiling.

00:04:36.017 --> 00:04:39.157
<v Meredith Whittaker>Like being able to read and write is pretty fundamental for anything.

00:04:39.677 --> 00:04:43.637
<v Meredith Whittaker>Und dann ich war poor so ich habe einen Job bei Google weil sie waren die ersten

00:04:43.637 --> 00:04:47.777
<v Meredith Whittaker>Menschen zu offeren mich ein Job und dann habe ich sehr fasziniert mit was auf

00:04:47.777 --> 00:04:49.757
<v Meredith Whittaker>der Erde was going on When war das?

00:04:50.017 --> 00:04:54.517
<v Linus Neumann>Wenn warst du bei Google als jemand der Studierende Literatur und Rhetorik?

00:04:54.977 --> 00:05:00.897
<v Meredith Whittaker>July 10, 2006 Ich habe mich über Berkeley und ich musste Geld und ich musste

00:05:00.897 --> 00:05:05.557
<v Meredith Whittaker>und ich put mein Resumé auf Monster.com which ist ein precursor zu LinkedIn,

00:05:06.177 --> 00:05:07.377
<v Meredith Whittaker>und ich habe mich überlegt out.

00:05:07.777 --> 00:05:11.717
<v Meredith Whittaker>And then I talked to my friend Michelangelo, because at the time you still needed

00:05:11.717 --> 00:05:14.057
<v Meredith Whittaker>to invite to join Gmail, as I recall.

00:05:14.237 --> 00:05:17.997
<v Meredith Whittaker>And I was like, hey, Michelangelo, can you get me an invite so I can make a

00:05:17.997 --> 00:05:20.777
<v Meredith Whittaker>Gmail address so I can appeal to this recruiter?

00:05:21.117 --> 00:05:25.257
<v Meredith Whittaker>And now my spam-filled Gmail address dates from that moment.

00:05:25.557 --> 00:05:29.117
<v Meredith Whittaker>So I was hired as something called a customer operations associate,

00:05:29.737 --> 00:05:31.677
<v Meredith Whittaker>and I didn't know what that was.

00:05:32.017 --> 00:05:34.677
<v Meredith Whittaker>No one knows what that is. It's just a bunch of words, But it sounded,

00:05:34.917 --> 00:05:37.837
<v Meredith Whittaker>I was like, that's a business job. It sounds like a business title.

00:05:38.037 --> 00:05:42.237
<v Meredith Whittaker>I had no idea. It was basically a customer support person who wrote technical

00:05:42.237 --> 00:05:46.597
<v Meredith Whittaker>documentation, who are kind of user documentation, some technical documentation,

00:05:46.597 --> 00:05:50.637
<v Meredith Whittaker>and answered inquiries about Google's free products.

00:05:50.897 --> 00:05:57.237
<v Meredith Whittaker>And I was doing that for Rightly, which was an acquisition that Google made

00:05:57.237 --> 00:06:00.897
<v Meredith Whittaker>that then they rebuilt to become Google Docs. Okay.

00:06:01.557 --> 00:06:06.397
<v Meredith Whittaker>Und das ist an der Zeit, die ganze Zeit, die Google-Businessen war, was nur Search.

00:06:06.557 --> 00:06:10.677
<v Meredith Whittaker>So Search war all auf der Main Campus. Es war wo die Money kam,

00:06:10.857 --> 00:06:17.757
<v Meredith Whittaker>und dann war das Dinky-little-Building, wo alles, Gmail, Blogger, Rightly, Reader,

00:06:19.197 --> 00:06:22.937
<v Meredith Whittaker>all of them sat und sie waren experimental projects. Und das war called Apps.

00:06:23.829 --> 00:06:28.009
<v Tim Pritlove>Did you ever have exposure to actual customers or did you just write documentation?

00:06:28.309 --> 00:06:34.449
<v Meredith Whittaker>Well, they would email in. I only did this for a second because I kind of figured

00:06:34.449 --> 00:06:37.049
<v Meredith Whittaker>out I wanted to do other things. And that's part of the story.

00:06:38.169 --> 00:06:42.089
<v Meredith Whittaker>There's a part of the story, actually. So I did answer inquiries sometimes.

00:06:42.329 --> 00:06:47.269
<v Meredith Whittaker>And there were auto responses, like hotkeys you'd use in this really janky ticketing system.

00:06:47.409 --> 00:06:51.029
<v Meredith Whittaker>And this is back. We didn't have laptops. There's no such thing as a smartphone.

00:06:51.769 --> 00:06:54.529
<v Meredith Whittaker>Our desktops were chained to the desk. Und wenn du nach Hause bist,

00:06:54.529 --> 00:06:56.929
<v Meredith Whittaker>wenn du nach Hause bist, wenn du nach Hause bist, dann musst du nachdenken.

00:06:57.069 --> 00:06:58.769
<v Meredith Whittaker>Du hast du nachdenken, das klunky Lenovo oder so.

00:06:59.289 --> 00:07:01.889
<v Meredith Whittaker>Ich weiß nicht genau, aber es war...

00:07:02.449 --> 00:07:07.929
<v Meredith Whittaker>Ich war mir, okay, ich werde rewarded in meinem Job, based auf wie viele Tickets ich close bin.

00:07:08.229 --> 00:07:10.849
<v Meredith Whittaker>Aber ich weiß nicht die Engenheer, die haben zu close diese Tickets,

00:07:10.869 --> 00:07:12.849
<v Meredith Whittaker>weil ich mich reporting bugs, und ich muss sie fix.

00:07:13.049 --> 00:07:15.549
<v Meredith Whittaker>Und wenn sie nicht fix die Bugs sind, dann bin ich nicht rewarded.

00:07:15.669 --> 00:07:17.549
<v Meredith Whittaker>Und ich war mir, das ist wirklich silly.

00:07:18.029 --> 00:07:21.049
<v Meredith Whittaker>So ich war über die Apps-Büte, weil ich in einer anderen Bühne bin bin.

00:07:21.049 --> 00:07:24.869
<v Meredith Whittaker>Und ich mit der engineering team und ich war, hey, ich bin das Person,

00:07:24.969 --> 00:07:26.749
<v Meredith Whittaker>die gibt es diese E-Mails, die Sie anwenden Sie.

00:07:27.249 --> 00:07:30.789
<v Meredith Whittaker>Und ich war able, zu convince einem einen zu gehen, zu Costco,

00:07:31.049 --> 00:07:35.189
<v Meredith Whittaker>die ist dieses große Warehouse-Store, ein Walmart-E-Store in den USA,

00:07:35.889 --> 00:07:41.369
<v Meredith Whittaker>und put ein giantes Kuchen auf seine eigene Karte, und bring es in den Apps-Bilden,

00:07:41.369 --> 00:07:42.569
<v Meredith Whittaker>so ich konnte sit mit dem.

00:07:42.809 --> 00:07:47.149
<v Meredith Whittaker>Weil wenn ich mit dem satte, dann könnte ich mit dem, und dann würde ich mich

00:07:47.149 --> 00:07:48.689
<v Meredith Whittaker>mehr möglich zu fixen, meine Bugs.

00:07:48.689 --> 00:07:53.249
<v Meredith Whittaker>Und so all my bugs started getting fixed but then my manager got really,

00:07:53.969 --> 00:07:57.309
<v Meredith Whittaker>upset because it was like obviously I had breached the hierarchy and I was like

00:07:57.309 --> 00:08:03.009
<v Meredith Whittaker>and so this meeting appeared on my calendar that was basically about me being

00:08:03.009 --> 00:08:06.129
<v Meredith Whittaker>insubordinate but I'm also like I didn't come from that class I had no I was

00:08:06.129 --> 00:08:08.309
<v Meredith Whittaker>like what the fuck did I do wrong I don't know,

00:08:08.849 --> 00:08:12.309
<v Meredith Whittaker>and I was like oh god I like I did something and then.

00:08:13.747 --> 00:08:17.027
<v Meredith Whittaker>The day before I think that meeting was going to happen, this email hit,

00:08:17.147 --> 00:08:22.327
<v Meredith Whittaker>we had this all, like some group, I don't know, it was like the group to the

00:08:22.327 --> 00:08:23.687
<v Meredith Whittaker>consumer operations team.

00:08:24.347 --> 00:08:28.347
<v Meredith Whittaker>And one of the engineering directors in Apps must have had like a beer or something

00:08:28.347 --> 00:08:31.207
<v Meredith Whittaker>during one of the many, many, many drinking parties that happened during the

00:08:31.207 --> 00:08:32.087
<v Meredith Whittaker>day at Google in that era.

00:08:33.887 --> 00:08:39.207
<v Meredith Whittaker>And sent some email that was like, Meredith, this couch is a model for collaboration.

00:08:40.427 --> 00:08:43.367
<v Linus Neumann>I was going to say, that's why you hired somebody from Berkeley.

00:08:44.627 --> 00:08:47.347
<v Linus Neumann>To write your tickets because they come up with ideas like that.

00:08:47.667 --> 00:08:51.007
<v Meredith Whittaker>And then that meeting just disappeared and I was like, well shit,

00:08:51.147 --> 00:08:54.087
<v Meredith Whittaker>I need another job because I just burned someone who's going to figure out how

00:08:54.087 --> 00:08:56.467
<v Meredith Whittaker>to get back at me and that's where my street sense comes in.

00:08:56.527 --> 00:09:02.107
<v Meredith Whittaker>So I took a bike around campus for a couple months and asked every VP during

00:09:02.107 --> 00:09:05.307
<v Meredith Whittaker>their office hours, which is a thing they used to have like, hey, I want another job.

00:09:05.447 --> 00:09:08.967
<v Meredith Whittaker>And I would just drop in and be like, hi, you don't know me. I'd like a job.

00:09:09.327 --> 00:09:16.467
<v Meredith Whittaker>And then I got a job doing basically Standards work, like trying to push document interop standards.

00:09:17.087 --> 00:09:21.267
<v Meredith Whittaker>And so I started in standards and then standards parlays into measurement pretty

00:09:21.267 --> 00:09:24.047
<v Meredith Whittaker>quickly because measurement is ultimately the methodological standard.

00:09:25.307 --> 00:09:30.467
<v Meredith Whittaker>And co-founded MLab and then that became the nucleus around which the research

00:09:30.467 --> 00:09:34.207
<v Meredith Whittaker>group I founded existed and then that was the...

00:09:35.242 --> 00:09:38.882
<v Meredith Whittaker>That was when the fresh air of sort of these political and social complexities

00:09:38.882 --> 00:09:42.962
<v Meredith Whittaker>started hitting my technical work. And I was like, oh, standardization is power.

00:09:43.282 --> 00:09:47.882
<v Meredith Whittaker>Oh, creating data means you own the narrative. Oh, shit, none of this is neutral.

00:09:47.882 --> 00:09:49.182
<v Meredith Whittaker>All of this is contingent.

00:09:49.302 --> 00:09:52.722
<v Meredith Whittaker>I started seeing the balance sheet. I started seeing the capital that was involved

00:09:52.722 --> 00:09:53.902
<v Meredith Whittaker>in running infrastructure.

00:09:54.462 --> 00:09:59.342
<v Meredith Whittaker>And I remember around the time I met you, Linus, like maybe over a decade ago.

00:09:59.542 --> 00:10:02.702
<v Linus Neumann>Yeah, it must have been about a decade or longer. Yeah, probably a bit longer even.

00:10:02.782 --> 00:10:04.542
<v Meredith Whittaker>Yeah, aging is weird.

00:10:06.762 --> 00:10:12.262
<v Meredith Whittaker>Aber ich habe diese schluss-Ballanz-Ballanz-Sheets. Ich habe aus Google gepritten,

00:10:12.942 --> 00:10:19.882
<v Meredith Whittaker>die gezeigt, wie viel die Uplink-Bandwidth und die Infrastruktur und Power-Costs für MLAB war.

00:10:19.882 --> 00:10:22.782
<v Meredith Whittaker>Und ich würde das zeigen, das zu all diese Civil Society funders,

00:10:22.782 --> 00:10:24.922
<v Meredith Whittaker>wie gesagt, Sie können 250k verdienen.

00:10:25.102 --> 00:10:29.562
<v Meredith Whittaker>Es kostet 40 Millionen a Jahr in Bandwidth, nur zu MLAB.

00:10:29.582 --> 00:10:32.962
<v Meredith Whittaker>Du wirst nicht verstehen, die economics of this, denn wir sind in der Era der

00:10:32.962 --> 00:10:35.962
<v Meredith Whittaker>Civic-Technik, All we need is a good idea, right?

00:10:36.302 --> 00:10:41.102
<v Meredith Whittaker>And I think I was really lucky to get sensitized to the political economy and

00:10:41.102 --> 00:10:43.022
<v Meredith Whittaker>the fact that we're talking about infrastructure,

00:10:43.442 --> 00:10:49.542
<v Meredith Whittaker>capital, network effects, economies of scale and not some kind of brilliant

00:10:49.542 --> 00:10:53.622
<v Meredith Whittaker>idea that just ephemerally transformed our world,

00:10:54.142 --> 00:10:58.142
<v Meredith Whittaker>and that our side just needs to wait to have one of those to get our turn.

00:10:58.422 --> 00:11:02.342
<v Tim Pritlove>That sounds like a quick upgrade from a customer support person.

00:11:02.882 --> 00:11:08.102
<v Tim Pritlove>Yeah, yeah, yeah. So, you mentioned MLab, which stands for Measurement Lab.

00:11:08.382 --> 00:11:08.962
<v Meredith Whittaker>It does, yeah.

00:11:09.022 --> 00:11:13.662
<v Tim Pritlove>Can you explain what this is all about and how it came alive and why you were involved?

00:11:13.982 --> 00:11:22.322
<v Meredith Whittaker>Yeah. It was a project that was Derek Slater, Vince Cerf, Stephen Stewart,

00:11:22.982 --> 00:11:27.062
<v Meredith Whittaker>Sasha Meinrath at Open Tech Institute.

00:11:29.005 --> 00:11:30.345
<v Tim Pritlove>The elders of the internet.

00:11:30.825 --> 00:11:33.285
<v Meredith Whittaker>Yeah, some old internet guys and me.

00:11:35.585 --> 00:11:37.165
<v Linus Neumann>Let's say the elders of the internet.

00:11:38.705 --> 00:11:39.965
<v Tim Pritlove>You're one of them now.

00:11:41.305 --> 00:11:47.745
<v Meredith Whittaker>And the lady with the couch. And the conceit there, which felt really simple

00:11:47.745 --> 00:11:50.725
<v Meredith Whittaker>to me at the time, is everyone is buzzing about net neutrality.

00:11:51.285 --> 00:11:56.545
<v Meredith Whittaker>And I was a Kool-Aid drinker. I still think the value underlying that kind of

00:11:56.545 --> 00:12:02.445
<v Meredith Whittaker>mythology, let's say, like, yes, we should not have one gatekeeper deciding

00:12:02.445 --> 00:12:06.125
<v Meredith Whittaker>which news source, right? This is old school common sense.

00:12:06.245 --> 00:12:09.025
<v Meredith Whittaker>It goes back to Western Union, who there's a little, you know,

00:12:09.185 --> 00:12:15.905
<v Meredith Whittaker>in the US would refuse to carry telegrams from political candidates the company didn't support, right?

00:12:15.965 --> 00:12:19.085
<v Meredith Whittaker>So there's a real bedrock precedent here.

00:12:19.785 --> 00:12:22.145
<v Meredith Whittaker>And I was like, yeah, of course we need net neutrality.

00:12:23.205 --> 00:12:27.625
<v Meredith Whittaker>Neutrality itself is a really wafty, it's a loose concept.

00:12:27.805 --> 00:12:32.605
<v Meredith Whittaker>It needs to be augured in some type of benchmark against which we can assess is this neutral or not.

00:12:32.605 --> 00:12:33.365
<v Tim Pritlove>You need to quantify it.

00:12:33.365 --> 00:12:39.205
<v Meredith Whittaker>Yes. And then you just flung into the abyss of philosophy the second you try to do that.

00:12:39.285 --> 00:12:45.905
<v Meredith Whittaker>But we started and I would say it was not necessarily built to succeed.

00:12:45.905 --> 00:12:49.785
<v Meredith Whittaker>It was built as a sort of hypothesis project where

00:12:49.785 --> 00:12:52.905
<v Meredith Whittaker>we stood up three servers that hosted

00:12:52.905 --> 00:12:56.865
<v Meredith Whittaker>open source measurement clients and the thing

00:12:56.865 --> 00:13:02.005
<v Meredith Whittaker>that we were doing was putting servers that were all configured the same that

00:13:02.005 --> 00:13:08.865
<v Meredith Whittaker>gave each client a dedicated slice of resources and then way over-provisioned

00:13:08.865 --> 00:13:13.905
<v Meredith Whittaker>the uplink between the server and the switch so that we could all,

00:13:15.005 --> 00:13:20.145
<v Meredith Whittaker>for all intents and purposes, guarantee that any artifacts that were detected

00:13:20.145 --> 00:13:24.045
<v Meredith Whittaker>through the measurement methodology like some TCP,

00:13:24.405 --> 00:13:29.625
<v Meredith Whittaker>RTT or something, were not interfered with by our infrastructure and weren't

00:13:29.625 --> 00:13:30.925
<v Meredith Whittaker>suffering for bandwidth.

00:13:31.205 --> 00:13:36.625
<v Tim Pritlove>So for practical reasons you had unlimited bandwidth and zero latency to everywhere.

00:13:36.925 --> 00:13:41.705
<v Meredith Whittaker>Yeah, and let's, you know, and that's very expensive. But then,

00:13:42.465 --> 00:13:47.805
<v Meredith Whittaker>we immediately DDoS the servers or like, oh shoot, because Vint's put a blog

00:13:47.805 --> 00:13:49.745
<v Meredith Whittaker>post out and he was you know he's a big name,

00:13:50.225 --> 00:13:55.105
<v Meredith Whittaker>and then it was like this job of years and years of getting servers in different

00:13:55.105 --> 00:13:59.145
<v Meredith Whittaker>interconnection points because we wanted to measure across consumer you know

00:13:59.145 --> 00:14:02.745
<v Meredith Whittaker>we're not just measuring to a server in the network exactly and we need to cross

00:14:02.745 --> 00:14:06.085
<v Meredith Whittaker>interconnection points to do that because that's where you begin to see interesting

00:14:06.085 --> 00:14:08.225
<v Meredith Whittaker>business relationships and kind of feuds,

00:14:09.285 --> 00:14:15.005
<v Meredith Whittaker>and it was just it was very it taught me about like how difficult and contingent and,

00:14:15.890 --> 00:14:23.610
<v Meredith Whittaker>ultimately subjective, creating data is, and the political process of then sort

00:14:23.610 --> 00:14:27.750
<v Meredith Whittaker>of defending that data as a reliable proxy for reality.

00:14:27.910 --> 00:14:31.810
<v Meredith Whittaker>Because I would be at the Federal Communications Commission and I had Comcast

00:14:31.810 --> 00:14:37.710
<v Meredith Whittaker>across from me being like, no, we want to measure it multi-threaded TCP versus

00:14:37.710 --> 00:14:41.590
<v Meredith Whittaker>single-threaded because you get a, let's just say, higher number that way.

00:14:41.590 --> 00:14:45.750
<v Meredith Whittaker>It's more forgiving. and we would be sort of defending the methodology of our

00:14:45.750 --> 00:14:48.550
<v Meredith Whittaker>tests and the openness principles.

00:14:48.830 --> 00:14:53.650
<v Meredith Whittaker>So it was open source code, the database architecture was open.

00:14:53.650 --> 00:14:58.970
<v Meredith Whittaker>I don't remember all the server architecture, it was old school,

00:14:59.810 --> 00:15:00.990
<v Meredith Whittaker>old school ideological.

00:15:00.990 --> 00:15:05.610
<v Tim Pritlove>You really don't sound like a book nerd now. You've become a real network nerd.

00:15:05.710 --> 00:15:09.730
<v Meredith Whittaker>Let's just say book nerds read and network stuff is written down.

00:15:13.190 --> 00:15:19.070
<v Meredith Whittaker>I read the fucking menu of it. I'm like, no one told me I was allowed to not

00:15:19.070 --> 00:15:20.590
<v Meredith Whittaker>read it and still have an opinion.

00:15:24.710 --> 00:15:26.250
<v Tim Pritlove>I love networking.

00:15:26.250 --> 00:15:31.050
<v Meredith Whittaker>It taught me everything about so much because you get down to the network layer

00:15:31.050 --> 00:15:34.910
<v Meredith Whittaker>and you're like, fuck, everything is broken. It's all tied together with string.

00:15:35.350 --> 00:15:41.610
<v Meredith Whittaker>What's going on? Okay, so your promises in the pitch meeting are guaranteed by this.

00:15:42.530 --> 00:15:47.010
<v Meredith Whittaker>This crusty old library that's maintained by a guy on a boat with a BitLocker

00:15:47.010 --> 00:15:48.470
<v Meredith Whittaker>account. Like, what is going on?

00:15:51.590 --> 00:15:52.810
<v Tim Pritlove>It's scary, isn't it?

00:15:53.090 --> 00:15:57.970
<v Meredith Whittaker>It is. I mean, it's a catalyst into today for my work.

00:15:59.530 --> 00:16:03.570
<v Linus Neumann>You did that for, I think, a couple of years, the MLab stuff.

00:16:03.810 --> 00:16:08.830
<v Linus Neumann>And you also, at this point in time, I think, began, you know, the ties to the,

00:16:09.743 --> 00:16:16.723
<v Linus Neumann>Let's say broader internet freedom community. I remember Uniprobe at the time, I think, was another.

00:16:17.683 --> 00:16:19.723
<v Linus Neumann>They still exist, right? They do.

00:16:19.923 --> 00:16:23.383
<v Meredith Whittaker>And we actually talked to them at Signal. They'll detect signal blocking.

00:16:24.003 --> 00:16:29.283
<v Meredith Whittaker>And I believe, so one of the things MLab did was provide backend infrastructure

00:16:29.283 --> 00:16:30.923
<v Meredith Whittaker>for projects like Uniprobe.

00:16:31.023 --> 00:16:33.703
<v Meredith Whittaker>And I don't actually know what that relationship is today.

00:16:35.743 --> 00:16:42.323
<v Meredith Whittaker>So academics and hackers and developers could write a test or kind of a measurement

00:16:42.323 --> 00:16:44.363
<v Meredith Whittaker>methodology deploy a client,

00:16:45.083 --> 00:16:49.883
<v Meredith Whittaker>to consumers like you test from your laptop or whatever and then we would be

00:16:49.883 --> 00:16:54.823
<v Meredith Whittaker>the ones paying for the bandwidth and infrastructure that would allow that to scale Uni.

00:16:54.823 --> 00:16:58.263
<v Linus Neumann>Is the Open Observatory of Network Interference.

00:16:58.263 --> 00:17:01.683
<v Meredith Whittaker>If I remember the acronym Hi Arturo So...

00:17:04.883 --> 00:17:10.143
<v Linus Neumann>Disclosing a whole social network here voluntarily. So, but eventually something

00:17:10.143 --> 00:17:14.283
<v Linus Neumann>happened that is known as the Google Walkouts.

00:17:14.503 --> 00:17:19.563
<v Linus Neumann>Was that following your MLab activities or during your MLab activities or did

00:17:19.563 --> 00:17:25.303
<v Linus Neumann>you rise even higher in the Google hierarchies before that happened?

00:17:25.563 --> 00:17:29.823
<v Meredith Whittaker>Well, I mean, there are many. I think, so...

00:17:30.806 --> 00:17:34.146
<v Meredith Whittaker>I was not working on MLAB by that point.

00:17:34.326 --> 00:17:40.926
<v Meredith Whittaker>MLAB, there's a part of this story that I didn't cover, which is around,

00:17:40.926 --> 00:17:43.226
<v Meredith Whittaker>I don't know, 2014, 2015,

00:17:45.086 --> 00:17:48.586
<v Meredith Whittaker>we started seeing really interesting artifacts in the data,

00:17:48.906 --> 00:17:55.066
<v Meredith Whittaker>which showed essentially that at particular interconnection points between particular

00:17:55.066 --> 00:18:00.106
<v Meredith Whittaker>telcos, we were seeing drastic drops in performance.

00:18:00.866 --> 00:18:06.306
<v Meredith Whittaker>And what we were able to do was look at, you know, every intersection of Telco

00:18:06.306 --> 00:18:09.146
<v Meredith Whittaker>1 and Telco 2, we see this drop.

00:18:10.026 --> 00:18:13.766
<v Meredith Whittaker>Intersections of Telco 3 and Telco 2 don't see this drop.

00:18:14.266 --> 00:18:17.906
<v Meredith Whittaker>And so what we're able to do is say, like, there's actually a business feud

00:18:17.906 --> 00:18:22.026
<v Meredith Whittaker>going on. And the interconnection point is the locus of that feud.

00:18:22.186 --> 00:18:24.846
<v Meredith Whittaker>And using traceroute data, we were able to say, like, look, these aren't,

00:18:24.986 --> 00:18:30.146
<v Meredith Whittaker>it's not just that they're sharing a path in some other region of the network that's slowing it down.

00:18:30.806 --> 00:18:32.506
<v Linus Neumann>They're actively throttling.

00:18:32.766 --> 00:18:37.566
<v Meredith Whittaker>They're actively throttling. And we put together a report on that.

00:18:37.786 --> 00:18:42.486
<v Meredith Whittaker>And this is where I was sort of, I think, kind of sideloading myself into some

00:18:42.486 --> 00:18:44.966
<v Meredith Whittaker>academic research work. I was like, okay, how do we do this?

00:18:45.786 --> 00:18:49.806
<v Meredith Whittaker>Document our methodology. Document sort of everything was open.

00:18:49.826 --> 00:18:51.066
<v Meredith Whittaker>So we pulled that together.

00:18:51.246 --> 00:18:56.566
<v Meredith Whittaker>And it showed, I don't know if you remember, there was a sort of Comcast Cogent Netflix.

00:18:56.806 --> 00:18:57.166
<v Linus Neumann>Oh, yeah.

00:18:57.166 --> 00:19:01.166
<v Meredith Whittaker>Netflix was shoving all its traffic through Cogent. What we had done is expose

00:19:01.166 --> 00:19:05.686
<v Meredith Whittaker>that and exposing that it exposed the principle that you have to if you wanted

00:19:05.686 --> 00:19:08.966
<v Meredith Whittaker>to ensure net neutrality, you have to take the interconnection points and the

00:19:08.966 --> 00:19:11.326
<v Meredith Whittaker>interconnection agreements into account.

00:19:11.566 --> 00:19:16.326
<v Meredith Whittaker>And that led Obama to add interconnection to the reclassification under Title

00:19:16.326 --> 00:19:21.046
<v Meredith Whittaker>II of these, you know, which kind of moved toward net neutrality that was nullified.

00:19:21.046 --> 00:19:27.166
<v Meredith Whittaker>But, you know, that was kind of the swan song, let's say, for my MLab time,

00:19:27.346 --> 00:19:29.546
<v Meredith Whittaker>because, of course, that was a huge deal, right?

00:19:29.586 --> 00:19:32.826
<v Meredith Whittaker>Like, that's where the business model rubber hits the road.

00:19:33.586 --> 00:19:37.006
<v Meredith Whittaker>And, you know, I'll just shorthand it. Like, that bought me a lot of capital at Google.

00:19:37.786 --> 00:19:41.246
<v Meredith Whittaker>And with that, I was, you know, I was already interested in a lot of things.

00:19:41.406 --> 00:19:44.926
<v Meredith Whittaker>MLab was sort of humming along and, like, it had grown from a hypothesis project

00:19:44.926 --> 00:19:48.546
<v Meredith Whittaker>to, like, a global thing that was working and doing stuff.

00:19:48.546 --> 00:19:53.726
<v Meredith Whittaker>And I started getting agitated by AI and a lot of these privacy and security

00:19:53.726 --> 00:19:56.866
<v Meredith Whittaker>concerns, being part of the community that you were part of,

00:19:57.046 --> 00:19:58.186
<v Meredith Whittaker>you know, kind of thinking around like

00:19:58.186 --> 00:20:01.986
<v Meredith Whittaker>tech alternatives and getting less comfortable with the business model.

00:20:03.226 --> 00:20:07.886
<v Meredith Whittaker>And from there I always had like eight different projects going on but I went

00:20:07.886 --> 00:20:13.586
<v Meredith Whittaker>on to found, to co-found the AI Now Institute which was really trying to bring the conversation,

00:20:14.326 --> 00:20:18.286
<v Meredith Whittaker>on what we called machine learning back then but like AI was like a flashier

00:20:18.286 --> 00:20:23.326
<v Meredith Whittaker>term, like bring it down to the ground a little bit and stop talking about superintelligence

00:20:23.326 --> 00:20:24.826
<v Meredith Whittaker>and stop talking about, you know,

00:20:25.826 --> 00:20:29.866
<v Meredith Whittaker>Political economy, what are these technologies, how are they being deployed,

00:20:30.046 --> 00:20:34.426
<v Meredith Whittaker>how do you oversee them, who uses them on whom, and what are the social and

00:20:34.426 --> 00:20:35.706
<v Meredith Whittaker>political dynamics of that.

00:20:36.106 --> 00:20:41.046
<v Linus Neumann>But the AI Now Institute is not hosted at Google, is it? No.

00:20:41.586 --> 00:20:43.046
<v Linus Neumann>Which university is it again?

00:20:43.246 --> 00:20:48.226
<v Meredith Whittaker>It was at NYU, and it's moved out of NYU for reasons of that being easier.

00:20:48.546 --> 00:20:49.026
<v Linus Neumann>Okay.

00:20:49.446 --> 00:20:52.506
<v Meredith Whittaker>And cheaper, because they take like 40%, those universities.

00:20:53.106 --> 00:20:53.346
<v Linus Neumann>Okay.

00:20:54.666 --> 00:20:56.986
<v Meredith Whittaker>Word to the wise, your money.

00:20:59.506 --> 00:21:00.586
<v Linus Neumann>What do you think?

00:21:00.786 --> 00:21:03.106
<v Tim Pritlove>Like whatever donations you get. Okay.

00:21:03.426 --> 00:21:06.866
<v Meredith Whittaker>Yeah. So it's an expensive brand.

00:21:10.046 --> 00:21:17.106
<v Linus Neumann>Well, for a reason, right? I mean, NYU Institute, that's something to have, I think, co-founded.

00:21:17.746 --> 00:21:22.366
<v Meredith Whittaker>Co-founded, yeah. I mean, the work was really good. And this was,

00:21:22.446 --> 00:21:26.026
<v Meredith Whittaker>again, gaining the capital at Google, cementing a reputation,

00:21:26.206 --> 00:21:28.366
<v Meredith Whittaker>being able to get to a level where I had a budget.

00:21:28.646 --> 00:21:33.946
<v Meredith Whittaker>And then part of what I was always trying to do is how much can I pull out of

00:21:33.946 --> 00:21:37.806
<v Meredith Whittaker>Google and get into the hands of people doing work that I think is cool.

00:21:38.006 --> 00:21:42.946
<v Meredith Whittaker>How do we carve tributaries in the massive river of this huge,

00:21:42.946 --> 00:21:46.026
<v Meredith Whittaker>rich company and get it out?

00:21:46.266 --> 00:21:50.386
<v Tim Pritlove>So you started that institute at the end of 2017.

00:21:51.906 --> 00:21:55.026
<v Meredith Whittaker>Well, beginnings are sometimes hard to date.

00:21:55.246 --> 00:22:03.226
<v Meredith Whittaker>It was born out of a request from the Obama administration to be the host of one of his AI summits.

00:22:03.286 --> 00:22:06.606
<v Meredith Whittaker>I don't remember exactly the contours there, but it was in 2016.

00:22:07.166 --> 00:22:13.506
<v Meredith Whittaker>And so it started as like, like the idea then was like, let's do this and let's do it big.

00:22:13.646 --> 00:22:18.626
<v Meredith Whittaker>Like, let's make this the most polished, flashiest, like hard to ignore kind

00:22:18.626 --> 00:22:23.146
<v Meredith Whittaker>of spectacle using all the tools we can get from like hiring an events agency,

00:22:23.326 --> 00:22:24.666
<v Meredith Whittaker>doing good press, all of that.

00:22:24.666 --> 00:22:31.586
<v Meredith Whittaker>But let's also make this the one that is the most engaged with these political topics,

00:22:31.586 --> 00:22:36.086
<v Meredith Whittaker>that's actually forcing the debate in that direction and kind of making it face

00:22:36.086 --> 00:22:39.886
<v Meredith Whittaker>these questions that are much more grounded and, you know,

00:22:40.046 --> 00:22:43.386
<v Meredith Whittaker>hopefully much more healthy for our population.

00:22:44.401 --> 00:22:50.561
<v Meredith Whittaker>So it was very successful and from there we got offers of funding and a lot

00:22:50.561 --> 00:22:53.661
<v Meredith Whittaker>of encouragement and the work just kept going.

00:22:53.661 --> 00:23:00.141
<v Tim Pritlove>Well, we in Europe, we are used to be a bit behind, but if I can recall 2016,

00:23:00.141 --> 00:23:04.321
<v Tim Pritlove>there was no discussion about AI in Europe at all.

00:23:04.741 --> 00:23:10.061
<v Tim Pritlove>And so, it's quite interesting to see that Obama has actually,

00:23:10.281 --> 00:23:16.361
<v Tim Pritlove>you know, decided that it's finally time to do something about this topic nobody

00:23:16.361 --> 00:23:18.101
<v Tim Pritlove>has ever really talked about.

00:23:18.321 --> 00:23:21.401
<v Linus Neumann>Germans are currently making up their mind whether that is a topic.

00:23:21.401 --> 00:23:25.081
<v Tim Pritlove>Ja, wir sprechen viel über Europa heute.

00:23:25.341 --> 00:23:33.801
<v Tim Pritlove>Aber mein Frage ist, kann man describe was kind of discussions going on 10 Jahre

00:23:33.801 --> 00:23:41.781
<v Tim Pritlove>ago in American society that this has come up to be something of a topic for the near future,

00:23:41.921 --> 00:23:44.441
<v Tim Pritlove>which actually became a big one.

00:23:45.941 --> 00:23:48.721
<v Tim Pritlove>Where did this discussion take place?

00:23:49.681 --> 00:23:54.901
<v Meredith Whittaker>Yeah, to answer this question, I'm going to be drawing on a lot of the research

00:23:54.901 --> 00:23:58.841
<v Meredith Whittaker>and the historical work, the work I've done since then.

00:23:58.961 --> 00:24:03.341
<v Meredith Whittaker>Because when this dawned in my life, when it started being a thing,

00:24:03.681 --> 00:24:07.341
<v Meredith Whittaker>I had basically that same question. What is this stuff?

00:24:07.481 --> 00:24:11.341
<v Meredith Whittaker>Why is it kind of... At Google, you would see...

00:24:12.464 --> 00:24:18.264
<v Meredith Whittaker>A shift toward a new paradigm or a new trend by the incentives that were structured

00:24:18.264 --> 00:24:20.444
<v Meredith Whittaker>into the OKRs, the quarterly goals,

00:24:21.024 --> 00:24:23.924
<v Meredith Whittaker>that kind of, you know, there'd be all these training modules that would pop

00:24:23.924 --> 00:24:28.024
<v Meredith Whittaker>up and it's like make your software engineer into an AI developer,

00:24:28.244 --> 00:24:30.384
<v Meredith Whittaker>you know, and you'd be like, there's an incentive here.

00:24:30.504 --> 00:24:32.744
<v Linus Neumann>Seems like they weren't too successful though, right? I mean,

00:24:32.784 --> 00:24:36.984
<v Linus Neumann>that's not like the biggest AI wave at Google.

00:24:37.464 --> 00:24:40.444
<v Meredith Whittaker>Well, they were, that was DeepMind era. So, okay, okay, good.

00:24:40.584 --> 00:24:40.704
<v Linus Neumann>Sorry.

00:24:40.704 --> 00:24:46.884
<v Meredith Whittaker>I think they were ahead. It was them and Meta for a long time. And the history...

00:24:46.884 --> 00:24:48.684
<v Linus Neumann>Didn't make it to the business though at the time, right?

00:24:48.884 --> 00:24:51.684
<v Meredith Whittaker>No, but they're chaotic. It's a kind of court in decline. So that,

00:24:52.164 --> 00:24:56.764
<v Meredith Whittaker>you know, actually where the... Actually the business model part has never been

00:24:56.764 --> 00:24:58.644
<v Meredith Whittaker>their strong suit beyond search.

00:24:58.944 --> 00:25:03.964
<v Meredith Whittaker>To be real, you know, like cloud is like the best technology presented confusingly

00:25:03.964 --> 00:25:07.204
<v Meredith Whittaker>with 18 versions all deprecated, right? Like that's... Um,

00:25:09.244 --> 00:25:16.444
<v Meredith Whittaker>um, but this, the, the AI stuff was, so if you look at the, if you look at the

00:25:16.444 --> 00:25:19.404
<v Meredith Whittaker>sort of recent history, which is something I'm spending, I've spent a lot of time on.

00:25:19.504 --> 00:25:22.644
<v Meredith Whittaker>I spend a lot of time on because I think we, you know, that gives us a really

00:25:22.644 --> 00:25:27.244
<v Meredith Whittaker>different picture than the Elon Musk narrative or the kind of popular narrative.

00:25:28.224 --> 00:25:33.784
<v Meredith Whittaker>There's a very important paper that was published in 2012 that introduced the

00:25:33.784 --> 00:25:39.584
<v Meredith Whittaker>AlexNet algorithm. und das war Jeff Hinton und his students, you may recognize.

00:25:39.704 --> 00:25:43.264
<v Tim Pritlove>Who just got the Nobel Prize. Physics, interestingly enough.

00:25:43.864 --> 00:25:45.184
<v Linus Neumann>Yeah, because there is no AI.

00:25:45.444 --> 00:25:48.124
<v Tim Pritlove>Yeah, because there is no computer Nobel Prize.

00:25:48.284 --> 00:25:51.944
<v Meredith Whittaker>Well, if you claim that your technology is everything, then you can get a prize in anything.

00:25:56.403 --> 00:25:58.203
<v Tim Pritlove>Which is a proven point now, yeah.

00:25:59.043 --> 00:26:05.763
<v Meredith Whittaker>And it was Ilya Stutzkever and then Alex. I'm sorry, Alex, I'm not grabbing

00:26:05.763 --> 00:26:08.123
<v Meredith Whittaker>your last name from the ether right now.

00:26:08.223 --> 00:26:12.323
<v Meredith Whittaker>But nonetheless, this was a paper that kind of pulled together key ingredients

00:26:12.323 --> 00:26:16.703
<v Meredith Whittaker>that became the foundation of the AI boom now.

00:26:16.843 --> 00:26:20.523
<v Meredith Whittaker>So this is deep learning algorithms, which is the paradigm we're still in.

00:26:20.603 --> 00:26:23.523
<v Meredith Whittaker>It doesn't matter. There's architectural sort of rejiggering,

00:26:23.623 --> 00:26:25.303
<v Meredith Whittaker>but nonetheless, it's deep learning.

00:26:26.323 --> 00:26:31.523
<v Meredith Whittaker>Huge amounts of data. So what I've called the derivatives of the surveillance business model.

00:26:31.603 --> 00:26:33.503
<v Tim Pritlove>He found all the cats on YouTube.

00:26:34.083 --> 00:26:36.043
<v Meredith Whittaker>I mean, yeah, that was Jeff Dean, I think.

00:26:38.183 --> 00:26:41.503
<v Meredith Whittaker>And then, you know, powerful compute, right?

00:26:41.623 --> 00:26:45.263
<v Meredith Whittaker>And they showed that sort of using gaming chips and a lot of data,

00:26:45.463 --> 00:26:47.083
<v Meredith Whittaker>you could beat the benchmark.

00:26:47.083 --> 00:26:53.163
<v Meredith Whittaker>So score much better against standard evaluations than past models and thus

00:26:53.163 --> 00:26:59.703
<v Meredith Whittaker>sort of catalyzed the industrial industry interest in AI and why were they interested?

00:26:59.943 --> 00:27:06.123
<v Meredith Whittaker>I think this is a key point because these optimist-seeking algorithms are really

00:27:06.123 --> 00:27:09.243
<v Meredith Whittaker>good at curating news feeds.

00:27:09.503 --> 00:27:13.903
<v Meredith Whittaker>They're really good at figuring out algorithms, right?

00:27:14.383 --> 00:27:18.783
<v Meredith Whittaker>I don't think it's an accident that Jeff was immediately hired,

00:27:20.063 --> 00:27:28.363
<v Meredith Whittaker>dass Jan LeCun, die die deep-learning-Algorithmen, die das Seed der Moment in

00:27:28.363 --> 00:27:32.043
<v Meredith Whittaker>AI in den 80ern, in den letzten 80ern, war er mit Meta.

00:27:32.063 --> 00:27:37.883
<v Meredith Whittaker>Und es war die Plattform-Companien mit der realen Investition in squeezing mehr

00:27:37.883 --> 00:27:43.263
<v Meredith Whittaker>Ad-Dollars aus der Daten, better-serving, all of das.

00:27:45.725 --> 00:27:51.125
<v Meredith Whittaker>Das ist Google mit DeepMind. Du sehen Meta und Google die leaders in das.

00:27:52.645 --> 00:27:57.025
<v Meredith Whittaker>Als measured by different evaluation standards, the measurement question hier

00:27:57.025 --> 00:27:59.065
<v Meredith Whittaker>ist eigentlich wirklich interesting und troubling.

00:27:59.665 --> 00:28:06.945
<v Meredith Whittaker>Until this generative moment where I think the ChatGPT Microsoft products shifted

00:28:06.945 --> 00:28:12.125
<v Meredith Whittaker>people's perception of AI and what it can do and just rearrange the leaderboard.

00:28:12.265 --> 00:28:16.405
<v Meredith Whittaker>But the paradigm is still the same And the paradigm is still that AI is applying

00:28:16.405 --> 00:28:22.225
<v Meredith Whittaker>old algorithms on top of the sort of massive platform monopoly business model,

00:28:22.585 --> 00:28:27.305
<v Meredith Whittaker>availing itself of huge amounts of data, which is produced via this surveillance

00:28:27.305 --> 00:28:32.165
<v Meredith Whittaker>business model, and really powerful compute that was designed,

00:28:32.565 --> 00:28:38.045
<v Meredith Whittaker>built up, you know, I would say, like, consolidated in the hands of these platform

00:28:38.045 --> 00:28:43.725
<v Meredith Whittaker>companies via the imperatives of the surveillance business model, right?

00:28:43.725 --> 00:28:48.045
<v Linus Neumann>Would you say that, so clearly, I mean, you say,

00:28:48.305 --> 00:28:53.025
<v Linus Neumann>so here are Google and Meta that have these massive amounts of data,

00:28:53.205 --> 00:28:57.345
<v Linus Neumann>like larger amounts of data than probably ever existed or were in the hands

00:28:57.345 --> 00:28:59.285
<v Linus Neumann>of anybody or any organization.

00:28:59.285 --> 00:29:07.345
<v Linus Neumann>Would you say that they had amassed all this data and eventually learned,

00:29:07.485 --> 00:29:11.245
<v Linus Neumann>okay, we probably can't handle this anymore, so we're interested in this new

00:29:11.245 --> 00:29:14.545
<v Linus Neumann>paradigm to even monetize this data any further?

00:29:14.905 --> 00:29:18.325
<v Linus Neumann>Or was it rather like, oh, we have all this data, we're monetizing it well,

00:29:18.325 --> 00:29:25.345
<v Linus Neumann>here's another way to monetize it on top of that. because clearly these deep

00:29:25.345 --> 00:29:29.285
<v Linus Neumann>learning algorithms are not of much use if you don't have large data.

00:29:29.285 --> 00:29:34.065
<v Meredith Whittaker>Set and large compute for both training and inference but is.

00:29:34.065 --> 00:29:37.345
<v Linus Neumann>It the hen egg what's the hen what's the egg there.

00:29:37.345 --> 00:29:40.765
<v Meredith Whittaker>I think this

00:29:40.765 --> 00:29:43.725
<v Meredith Whittaker>is almost a perpetual motion machine right like

00:29:43.725 --> 00:29:49.245
<v Meredith Whittaker>every quarter you have to report progress you have to report growth the logic

00:29:49.245 --> 00:29:55.045
<v Meredith Whittaker>is metastasis and so you know you're trying to squeeze more out of what you

00:29:55.045 --> 00:29:57.845
<v Meredith Whittaker>have and you're trying to get more of what you have so you can squeeze more

00:29:57.845 --> 00:30:02.465
<v Meredith Whittaker>right there's also these sort of laws of scale remember big data we used to call it that,

00:30:04.085 --> 00:30:08.945
<v Meredith Whittaker>and so I don't I don't actually know the answer to your question but I think it,

00:30:10.094 --> 00:30:17.154
<v Meredith Whittaker>Which came first? But, well, I mean, the business model came first, right?

00:30:17.234 --> 00:30:19.914
<v Meredith Whittaker>You had to have the ingredients to know what they did together.

00:30:20.754 --> 00:30:25.774
<v Meredith Whittaker>And I think it was deep learning and AI had sort of languished in the backwater

00:30:25.774 --> 00:30:33.014
<v Meredith Whittaker>with some interesting experiments through the 2000s because its history is always

00:30:33.014 --> 00:30:37.254
<v Meredith Whittaker>promising too much and disappointing since the mid-50s when it was invented.

00:30:38.214 --> 00:30:44.794
<v Meredith Whittaker>And I think the goal was really to sort of supercharge their existing business model.

00:30:45.894 --> 00:30:50.554
<v Tim Pritlove>I think deep learning was just the technology that perfectly served their current

00:30:50.554 --> 00:30:53.134
<v Tim Pritlove>beliefs in that they have to work on the data,

00:30:53.314 --> 00:30:58.514
<v Tim Pritlove>that they have to build up algorithms to somehow predict your personal future

00:30:58.514 --> 00:31:03.874
<v Tim Pritlove>and be there with an ad before you even know it and we've seen this,

00:31:05.034 --> 00:31:12.214
<v Tim Pritlove>as an ad everywhere and we've also seen it in political influence as we've seen in the Brexit,

00:31:13.494 --> 00:31:20.954
<v Tim Pritlove>decision and also in the elections where we heard there's going to be one in

00:31:20.954 --> 00:31:24.454
<v Tim Pritlove>the near future as well in the US that might be influenced as well.

00:31:24.554 --> 00:31:25.274
<v Meredith Whittaker>Let me check my calendar.

00:31:27.494 --> 00:31:32.014
<v Meredith Whittaker>I mean I think we can like peel back also just this concept of like what is

00:31:32.014 --> 00:31:34.374
<v Meredith Whittaker>an advertisement right? It's an influence.

00:31:35.234 --> 00:31:38.294
<v Meredith Whittaker>Is it trying to get you to buy something? Is it trying to get you to like something?

00:31:38.414 --> 00:31:42.554
<v Meredith Whittaker>Is it trying to get you to believe something? Is it trying to get you to vote a certain way?

00:31:42.834 --> 00:31:48.834
<v Meredith Whittaker>And I think that the term advertisement is usefully deconstructed when we start

00:31:48.834 --> 00:31:52.334
<v Meredith Whittaker>to think about the connection between all of those.

00:31:52.494 --> 00:31:57.134
<v Linus Neumann>The term advertising is one of the best tricks the devil ever pulled.

00:31:58.174 --> 00:32:02.974
<v Linus Neumann>Because it's behavior manipulation. It's a stated goal. But I remember when.

00:32:02.974 --> 00:32:08.034
<v Linus Neumann>The first debates came up about, for example, the Cambridge Analytica scan.

00:32:08.154 --> 00:32:12.734
<v Linus Neumann>It's like, they used Facebook data to manipulate voters.

00:32:12.774 --> 00:32:16.674
<v Linus Neumann>And it's like, no, there's a red line over here. You can't manipulate behavior.

00:32:17.194 --> 00:32:23.974
<v Linus Neumann>I mean, Facebook and Google were basically built to manipulate users' behavior

00:32:23.974 --> 00:32:28.174
<v Linus Neumann>and ideally capture their attention to change their behavior.

00:32:28.174 --> 00:32:31.254
<v Linus Neumann>Wir haben wahrscheinlich dieses shirt oder das oder das oder das oder das oder

00:32:31.254 --> 00:32:33.774
<v Linus Neumann>das oder das oder das oder das oder das oder das oder das oder das oder das oder das ist.

00:32:35.234 --> 00:32:37.834
<v Linus Neumann>Wie können wir das so etwas machen? Das ist unheard of.

00:32:40.489 --> 00:32:44.749
<v Linus Neumann>So viewing advertising as like, oh, this is just an offer.

00:32:45.109 --> 00:32:49.709
<v Linus Neumann>This is, oh, we're just making our product. No, no, I have a limited amount of attention per day.

00:32:49.829 --> 00:32:53.329
<v Linus Neumann>You're capturing it and you're doing it with one simple reason.

00:32:53.329 --> 00:32:59.049
<v Linus Neumann>And that is changing my behavior in the sense that you aim for.

00:32:59.149 --> 00:33:01.009
<v Linus Neumann>And I guess eventually it sounds like,

00:33:03.349 --> 00:33:06.329
<v Linus Neumann>eventually you questioned your Google career, right? Because you were,

00:33:06.529 --> 00:33:09.849
<v Linus Neumann>I mean, clearly you had an impressive career there in just a few years.

00:33:10.489 --> 00:33:17.869
<v Linus Neumann>Um, but you began to question not only your, like Google and the company culture,

00:33:18.049 --> 00:33:20.209
<v Linus Neumann>but apparently also a little bit your,

00:33:20.789 --> 00:33:29.889
<v Linus Neumann>your, the way you want to continue with your, with your, you know,

00:33:29.969 --> 00:33:32.329
<v Linus Neumann>making use of the influence and the knowledge you have.

00:33:32.729 --> 00:33:34.069
<v Meredith Whittaker>Yeah. I think.

00:33:34.449 --> 00:33:35.689
<v Linus Neumann>Is that the walkouts?

00:33:35.689 --> 00:33:43.969
<v Meredith Whittaker>I mean, it's all interlinked and kind of periodizing your own consciousness is hard.

00:33:46.009 --> 00:33:52.209
<v Meredith Whittaker>But I think I'm pretty earnest and I also don't come from that world,

00:33:52.229 --> 00:33:55.609
<v Meredith Whittaker>I don't come from that class so there are often places where I just didn't,

00:33:55.609 --> 00:34:00.889
<v Meredith Whittaker>you know, I would take things sincerely or be like really committed and then only realize like

00:34:01.309 --> 00:34:04.629
<v Meredith Whittaker>two thirds of the way through whatever it was like oh no one else really cares

00:34:04.629 --> 00:34:08.029
<v Meredith Whittaker>about this they're just networking or you know whatever it was so I think there

00:34:08.029 --> 00:34:11.309
<v Meredith Whittaker>was an element there where like you know when I was doing MLab I was like I

00:34:11.309 --> 00:34:14.889
<v Meredith Whittaker>really want to win net neutrality Und dann we won net neutrality.

00:34:15.009 --> 00:34:17.869
<v Meredith Whittaker>Aber dann ist das, dass ich das nicht der Fall war.

00:34:18.149 --> 00:34:21.329
<v Meredith Whittaker>Google hat eine größere Netzwerke als Comcast. Das ist nicht die Gatekeeper.

00:34:22.149 --> 00:34:24.929
<v Meredith Whittaker>Aber das war eine Sincere Sache.

00:34:25.189 --> 00:34:26.849
<v Meredith Whittaker>Und dann war ich, okay, ich kann mich,

00:34:27.189 --> 00:34:32.889
<v Meredith Whittaker>um, Geld zu all diese coolen Privatsch-Hacker-Projekte. Das war Sincere.

00:34:33.589 --> 00:34:37.769
<v Meredith Whittaker>Und dann wurde ich in AI und ich war, okay, und ich denke, das ist etwas,

00:34:37.869 --> 00:34:38.889
<v Meredith Whittaker>das hat sich verändert für mich.

00:34:40.863 --> 00:34:48.983
<v Meredith Whittaker>I think I used to have a lot, lot more faith in the power of ideas to influence real change, right?

00:34:49.103 --> 00:34:52.703
<v Meredith Whittaker>And I still think, you know, I spend a lot of time in kind of thinking through

00:34:52.703 --> 00:34:54.363
<v Meredith Whittaker>discourses, how do we shape them?

00:34:54.483 --> 00:34:59.563
<v Meredith Whittaker>Like, how do we kindly walk people into understanding things that,

00:34:59.703 --> 00:35:03.263
<v Meredith Whittaker>you know, they may have an interest in not understanding or they may have been,

00:35:03.263 --> 00:35:05.683
<v Meredith Whittaker>you know, misinformed about or what have you.

00:35:06.523 --> 00:35:13.483
<v Meredith Whittaker>But I began you know I began around the time I was looking at AI and sort of making all these cases,

00:35:13.983 --> 00:35:18.143
<v Meredith Whittaker>that everyone loved right like I was out there giving talks that were completely

00:35:18.143 --> 00:35:20.663
<v Meredith Whittaker>against the Google party line and I was getting like applauses,

00:35:20.843 --> 00:35:24.223
<v Meredith Whittaker>I was getting promoted like I was like this is a this is a perfect job.

00:35:29.743 --> 00:35:36.243
<v Meredith Whittaker>And then you know like I was I envied you not only once I'm the house troll,

00:35:39.083 --> 00:35:42.983
<v Meredith Whittaker>but then there was I was getting more influence so I was becoming known outside

00:35:42.983 --> 00:35:46.043
<v Meredith Whittaker>and inside I was like the person you'd call into your team when it was like

00:35:46.043 --> 00:35:49.343
<v Meredith Whittaker>oh we want to implement this is there an ethical way to do it,

00:35:50.863 --> 00:35:56.623
<v Meredith Whittaker>and you would say no I would, I would be like my dear friends let us sit down,

00:36:00.543 --> 00:36:08.263
<v Meredith Whittaker>and then I was getting, I don't know, that was sort of my life and we kind of

00:36:08.263 --> 00:36:12.863
<v Meredith Whittaker>took the AI Now Institute and really did a lot to reshape the debate.

00:36:13.103 --> 00:36:16.763
<v Meredith Whittaker>I was very focused on that discursive intervention and how do we begin to talk

00:36:16.763 --> 00:36:21.143
<v Meredith Whittaker>about AI in a more realistic way and that was working outside of Google but

00:36:21.143 --> 00:36:26.063
<v Meredith Whittaker>it wasn't really influencing core decisions at Google and that was kind of the

00:36:26.063 --> 00:36:32.003
<v Meredith Whittaker>thing I kept hitting up against more and more strongly until I got a signal message in...

00:36:33.088 --> 00:36:34.328
<v Meredith Whittaker>Late 2017.

00:36:34.888 --> 00:36:35.468
<v Linus Neumann>From Moxie?

00:36:36.488 --> 00:36:41.068
<v Meredith Whittaker>No, I mean, I probably did get one from Moxie at that time, but this one was not that one.

00:36:41.968 --> 00:36:46.668
<v Meredith Whittaker>It was from a friend of mine at Google who said, yo, there's a really disturbing

00:36:46.668 --> 00:36:50.048
<v Meredith Whittaker>project that is hidden that I'm very close to.

00:36:50.768 --> 00:36:55.428
<v Meredith Whittaker>And you should know about it because you're the AI person who cares about this

00:36:55.428 --> 00:36:57.808
<v Meredith Whittaker>and you have standing at the company around it.

00:36:57.908 --> 00:37:01.388
<v Meredith Whittaker>And this was the secretive contract that Google signed with the Department of

00:37:01.388 --> 00:37:06.588
<v Meredith Whittaker>Defense to build AI drone targeting and surveillance systems for the drone war.

00:37:07.248 --> 00:37:11.768
<v Meredith Whittaker>And of course, like I was politicized post 9-11, post Snowden.

00:37:11.848 --> 00:37:15.888
<v Meredith Whittaker>Like this was, you know, the drone war and the signature strike and all of that

00:37:15.888 --> 00:37:20.948
<v Meredith Whittaker>were really core in kind of my, you know, things that I ideologically rejected

00:37:20.948 --> 00:37:25.528
<v Meredith Whittaker>and, you know, felt like we needed to disarm, not supercharge.

00:37:26.828 --> 00:37:32.508
<v Meredith Whittaker>And I had like a, you know, like a righteous anger. I was just like, fuck this.

00:37:32.748 --> 00:37:37.468
<v Linus Neumann>Because you're there running around, you know, trying to shape the discourse on AI.

00:37:38.288 --> 00:37:41.908
<v Meredith Whittaker>And making them look good, right? Because they get to be like,

00:37:41.988 --> 00:37:46.468
<v Meredith Whittaker>look, we platform such heterodox voices. We're surely benevolent, right?

00:37:46.608 --> 00:37:50.748
<v Meredith Whittaker>And then I'm like, okay, and then you're inking this deal with the DoD behind

00:37:50.748 --> 00:37:55.248
<v Meredith Whittaker>the scenes for technology that one we know doesn't sort of work for the purpose, right?

00:37:55.348 --> 00:37:58.788
<v Meredith Whittaker>Like, you know, it's not going to better identify a worthy

00:37:58.788 --> 00:38:01.528
<v Meredith Whittaker>target of death oder whatever the fuck it's you know it's not you

00:38:01.528 --> 00:38:05.228
<v Meredith Whittaker>know we know this is bullshit but like and you

00:38:05.228 --> 00:38:08.388
<v Meredith Whittaker>know this is a multinational company like more than

00:38:08.388 --> 00:38:11.868
<v Meredith Whittaker>half the employees are outside the US there is an issue with yoking yourself

00:38:11.868 --> 00:38:17.068
<v Meredith Whittaker>to you know not that you have one nation's government not that many tech companies

00:38:17.068 --> 00:38:22.668
<v Meredith Whittaker>care that much about that and then there was just the you know what is the structural

00:38:22.668 --> 00:38:25.768
<v Meredith Whittaker>danger which is deeply acute and,

00:38:26.660 --> 00:38:30.840
<v Meredith Whittaker>of a massive surveillance company with more data than the world has ever seen,

00:38:31.000 --> 00:38:35.040
<v Meredith Whittaker>more compromised than you can imagine, like yoking their fortunes and a key

00:38:35.040 --> 00:38:39.960
<v Meredith Whittaker>dependency to the US military, right?

00:38:40.180 --> 00:38:42.980
<v Meredith Whittaker>And, you know, we know from Snowden that that's already like,

00:38:43.120 --> 00:38:47.700
<v Meredith Whittaker>you know, seen as, you know, as long as it's a corporation gathering it, it's not, you know.

00:38:47.900 --> 00:38:51.560
<v Tim Pritlove>Was Google still running under the motto of don't be evil at the time?

00:38:51.860 --> 00:38:54.660
<v Meredith Whittaker>They were, they were. And that was, we marshaled that actually.

00:38:54.660 --> 00:38:57.220
<v Tim Pritlove>Kind of like the end of it, wasn't it?

00:38:58.700 --> 00:39:03.660
<v Meredith Whittaker>They quietly, like the lawyers removed that from the Google Manifesto.

00:39:04.900 --> 00:39:08.300
<v Meredith Whittaker>It was slowly fading. Yeah, it was like, they were like, just don't open that closet.

00:39:08.300 --> 00:39:12.980
<v Tim Pritlove>Which motto? I don't recall any. It's like, do you know something about this?

00:39:13.660 --> 00:39:15.880
<v Meredith Whittaker>Try not to be bad is the new motto.

00:39:18.960 --> 00:39:20.560
<v Tim Pritlove>Don't be as bad as that.

00:39:20.560 --> 00:39:24.160
<v Meredith Whittaker>Yeah, like lay off the evil.

00:39:25.860 --> 00:39:29.320
<v Meredith Whittaker>Ja, so I mean, and this was, there were like a lot of old school people there

00:39:29.320 --> 00:39:32.940
<v Meredith Whittaker>at that time who really did drink the Kool-Aid and so it was you know,

00:39:33.060 --> 00:39:37.340
<v Meredith Whittaker>I just put my energy into organizing against that and that was when I turned

00:39:37.340 --> 00:39:41.300
<v Meredith Whittaker>toward labor organizing and thinking through traditional,

00:39:42.920 --> 00:39:48.260
<v Meredith Whittaker>methods and approaches to combating that type of corporate power or you know

00:39:48.260 --> 00:39:54.840
<v Meredith Whittaker>industrial power and we, you know, and that That was the on-ramp to the walkout.

00:39:54.960 --> 00:39:58.420
<v Meredith Whittaker>So the walkout was like a big, that was like a rupture, like a manifestation.

00:39:58.420 --> 00:40:02.460
<v Meredith Whittaker>It got a lot of press and it was the biggest labor action in tech.

00:40:02.940 --> 00:40:07.280
<v Tim Pritlove>So just to make that clear, the walkouts were actually people walking outside

00:40:07.280 --> 00:40:11.460
<v Tim Pritlove>of the Google buildings for, I don't know, how long?

00:40:12.080 --> 00:40:17.520
<v Meredith Whittaker>I think it was November 11th, 2018.

00:40:18.680 --> 00:40:25.560
<v Meredith Whittaker>Und everyone walked out for 20 minutes at 11.11am in their local time so we

00:40:25.560 --> 00:40:30.440
<v Meredith Whittaker>called it Rolling Thunder and it started in the Singapore office as I was going

00:40:30.440 --> 00:40:32.760
<v Meredith Whittaker>to bed in New York and I was seeing the photos,

00:40:34.000 --> 00:40:38.900
<v Meredith Whittaker>and this was chaos I hadn't slept in days there's so many meetings there's so

00:40:38.900 --> 00:40:41.520
<v Meredith Whittaker>many tears it's hard to organize something like that,

00:40:42.320 --> 00:40:48.080
<v Meredith Whittaker>and I remember going to bed and seeing the images from Singapore mit ein paar

00:40:48.080 --> 00:40:52.580
<v Meredith Whittaker>hundert Leuten in Singapur und ich war,

00:40:54.200 --> 00:40:56.100
<v Meredith Whittaker>das ist großartig.

00:40:56.340 --> 00:40:59.880
<v Meredith Whittaker>Und dann habe ich New York time gewohnt, um 5 a.m. zu gehen in New York zu unserer

00:40:59.880 --> 00:41:03.380
<v Meredith Whittaker>location und prepen es, um, dass wir uns da sind.

00:41:06.014 --> 00:41:08.914
<v Meredith Whittaker>And then I just remember seeing, like, there was this little park near the New

00:41:08.914 --> 00:41:12.074
<v Meredith Whittaker>York office, and then it just, like, grew outside the park.

00:41:12.174 --> 00:41:14.954
<v Meredith Whittaker>And then no one could get into the park. And then I was looking at my home,

00:41:15.034 --> 00:41:18.034
<v Meredith Whittaker>and there's my phone, and there's live helicopter feeds.

00:41:18.674 --> 00:41:21.694
<v Meredith Whittaker>And we don't have bullhorns, because I'm one of the speakers.

00:41:21.694 --> 00:41:24.714
<v Meredith Whittaker>There's, like, speakers standing on chairs to address the crowd.

00:41:25.294 --> 00:41:29.634
<v Meredith Whittaker>And then this guy, like, some, you know, there's this sort of type.

00:41:29.714 --> 00:41:31.694
<v Meredith Whittaker>I don't know if in Germany you have this type, but they're, like,

00:41:31.754 --> 00:41:34.594
<v Meredith Whittaker>kind of, like, the leftist at every protest.

00:41:34.594 --> 00:41:40.494
<v Meredith Whittaker>And like some guy had like found out about it and came in and I just remember this like,

00:41:41.174 --> 00:41:46.294
<v Meredith Whittaker>like this man I'd never seen like handing me a bullhound from below and I picked

00:41:46.294 --> 00:41:49.834
<v Meredith Whittaker>it up and like we were like bullhound like a megaphone like a megaphone yeah yeah yeah.

00:41:52.894 --> 00:41:56.394
<v Meredith Whittaker>And then it was you know and then we walked over

00:41:56.394 --> 00:41:59.734
<v Meredith Whittaker>to a Mexican restaurant and sat at the table and had a press operation

00:41:59.734 --> 00:42:04.514
<v Meredith Whittaker>where like that we were running and what was cool was like everyone organizing

00:42:04.514 --> 00:42:08.574
<v Meredith Whittaker>that was kind of a professional most of them were femme and most of them had

00:42:08.574 --> 00:42:12.774
<v Meredith Whittaker>jobs at Google that were like organizing the company so organizing their comms

00:42:12.774 --> 00:42:16.514
<v Meredith Whittaker>being an administrator for like 13 different directors,

00:42:17.354 --> 00:42:22.574
<v Meredith Whittaker>this particular type of hyper competence at coordinating activity across a number

00:42:22.574 --> 00:42:27.714
<v Meredith Whittaker>of people who you may not have direct power over and like for that much more.

00:42:27.714 --> 00:42:29.274
<v Tim Pritlove>Than developers in that.

00:42:29.274 --> 00:42:34.834
<v Meredith Whittaker>Respect I mean let's just say Yeah, yes. You know, you can, like somebody who

00:42:34.834 --> 00:42:39.954
<v Meredith Whittaker>can write an email and get someone to respond to that email by doing a thing is kind of a witch.

00:42:41.954 --> 00:42:46.254
<v Meredith Whittaker>And it was all these like these preternaturally competent femmes just turning

00:42:46.254 --> 00:42:49.914
<v Meredith Whittaker>that energy toward organizing across the company,

00:42:49.914 --> 00:42:54.794
<v Meredith Whittaker>which was building on this sort of base of meetings and locals and all of this

00:42:54.794 --> 00:43:00.574
<v Meredith Whittaker>sort of work that we'd done to kind of form a discursive environment inside

00:43:00.574 --> 00:43:03.574
<v Meredith Whittaker>Google where we're like weekly meetings to discuss the news,

00:43:03.774 --> 00:43:05.714
<v Meredith Whittaker>what Google could do, what campaigns we could do.

00:43:05.794 --> 00:43:10.214
<v Meredith Whittaker>So we had this sort of energy and solidarity already at that point.

00:43:10.574 --> 00:43:17.634
<v Tim Pritlove>How many percent of the Google employees would you say have at one point taken part in this?

00:43:17.914 --> 00:43:19.634
<v Meredith Whittaker>I don't know. we were really careful

00:43:19.634 --> 00:43:26.234
<v Meredith Whittaker>not to keep lists yeah I mean you can dream up a number now you know I.

00:43:27.696 --> 00:43:33.876
<v Meredith Whittaker>20,000 was the number estimated from the Sky Photos and the local reports.

00:43:33.936 --> 00:43:35.876
<v Meredith Whittaker>We had local leads at every office.

00:43:36.576 --> 00:43:41.176
<v Meredith Whittaker>We sent them zip files of the kit for handing out the flyers,

00:43:41.276 --> 00:43:43.396
<v Meredith Whittaker>the talking points, how to treat media, all of that.

00:43:43.596 --> 00:43:47.056
<v Meredith Whittaker>They all had that, and then they organized their local. And then they had reporting

00:43:47.056 --> 00:43:51.096
<v Meredith Whittaker>back in from press, reporting back into the central organizers around numbers.

00:43:51.116 --> 00:43:54.736
<v Meredith Whittaker>And then we were issuing the press releases. um but

00:43:54.736 --> 00:43:58.476
<v Meredith Whittaker>then you know there's employees of google and

00:43:58.476 --> 00:44:01.816
<v Meredith Whittaker>then there's contractors of google which more than double employees so

00:44:01.816 --> 00:44:04.636
<v Meredith Whittaker>it you know that number is and and then there's people who

00:44:04.636 --> 00:44:07.556
<v Meredith Whittaker>couldn't participate but were really supportive because they

00:44:07.556 --> 00:44:11.616
<v Meredith Whittaker>have you know need their health insurance or they'll die or they are on a visa

00:44:11.616 --> 00:44:17.936
<v Meredith Whittaker>and so it wasn't um i think there was a huge amount of support uh i know that

00:44:17.936 --> 00:44:22.236
<v Meredith Whittaker>we were able to get google to drop their military contract because there was

00:44:22.236 --> 00:44:25.816
<v Meredith Whittaker>enough support and there was you know there was like a spreadsheet of people who are quitting,

00:44:26.556 --> 00:44:30.376
<v Meredith Whittaker>conscientious objectors we had you know like every week at the all-town meeting

00:44:30.376 --> 00:44:34.356
<v Meredith Whittaker>there was a table we would set up with like banners and something like we would

00:44:34.356 --> 00:44:36.496
<v Meredith Whittaker>had questions like it was a very,

00:44:36.976 --> 00:44:43.676
<v Meredith Whittaker>it was a very like rigorous campaign and it kind of laid the laid the groundwork

00:44:43.676 --> 00:44:48.016
<v Meredith Whittaker>and i think it built some muscle that people are probably almost are definitely

00:44:48.016 --> 00:44:50.736
<v Meredith Whittaker>using now even if they don't call at organizing.

00:44:51.076 --> 00:44:53.956
<v Meredith Whittaker>It's like, how do we marshal the resources from this?

00:44:54.336 --> 00:44:57.636
<v Tim Pritlove>So did Google then still love you at that point?

00:44:57.896 --> 00:45:03.636
<v Meredith Whittaker>Well, I think Google does still love me, but it doesn't love itself enough to admit it.

00:45:10.236 --> 00:45:11.676
<v Tim Pritlove>They have issues, I think.

00:45:16.016 --> 00:45:19.576
<v Meredith Whittaker>I do think that. Come on, come on. Which side do you want to be on?

00:45:19.576 --> 00:45:22.076
<v Meredith Whittaker>Which party do you want to go to? Let's be real.

00:45:23.436 --> 00:45:27.936
<v Tim Pritlove>I mean, it leads to an interesting point because I would say,

00:45:28.736 --> 00:45:35.996
<v Tim Pritlove>looking from the other side of the ocean, I think to us, this whole tech scene,

00:45:37.468 --> 00:45:42.668
<v Tim Pritlove>The startups, the new stuff, the internet, everything that has developed in

00:45:42.668 --> 00:45:47.988
<v Tim Pritlove>the last 20 years or so, always had this liberal touch to it.

00:45:49.228 --> 00:45:57.668
<v Tim Pritlove>It felt as if it was mostly about an open, world-loving agenda and it's good for everybody.

00:45:58.028 --> 00:46:06.068
<v Tim Pritlove>And Google kind of tuned in with their motto and some other companies did as well, some not so much.

00:46:06.068 --> 00:46:14.388
<v Tim Pritlove>But it was always this feeling that liberal thinking is at the core of everything

00:46:14.388 --> 00:46:16.308
<v Tim Pritlove>that is driving the internet forward.

00:46:17.728 --> 00:46:26.288
<v Tim Pritlove>And I think we stopped thinking that now because it looks totally different right now.

00:46:28.068 --> 00:46:38.928
<v Tim Pritlove>Currently, we have more the feeling that it's turned into a total right-wing apocalypse somehow.

00:46:39.268 --> 00:46:42.928
<v Tim Pritlove>And I haven't really seen this coming.

00:46:43.228 --> 00:46:49.088
<v Tim Pritlove>Can you explain what happened to this tech scene? What happened?

00:46:50.788 --> 00:47:01.208
<v Meredith Whittaker>I, well, you know, I think about post 9-11 and a lot of the fights over surveillance and tech.

00:47:03.668 --> 00:47:11.328
<v Meredith Whittaker>And there's a talk that, who was, Frank Rieger and Rupert Gronkripp?

00:47:11.368 --> 00:47:12.548
<v Tim Pritlove>Rob Gronkripp, Rob Gronkripp.

00:47:12.748 --> 00:47:16.768
<v Meredith Whittaker>Sorry, I don't, that's my American, you'll do beautifully in America.

00:47:17.048 --> 00:47:17.688
<v Tim Pritlove>It's complicated for us.

00:47:17.688 --> 00:47:21.028
<v Meredith Whittaker>Ja, aber ich entschuldige für nicht das richtig.

00:47:21.068 --> 00:47:21.608
<v Tim Pritlove>Roppenfrank.

00:47:21.828 --> 00:47:27.508
<v Meredith Whittaker>Ja, ich habe diese Talk, We Lost the War, ich glaube es war 1994. Nein, 2004.

00:47:27.768 --> 00:47:28.308
<v Tim Pritlove>Ja.

00:47:28.928 --> 00:47:30.108
<v Meredith Whittaker>Ich habe die gleiche Sache gemacht.

00:47:34.948 --> 00:47:44.628
<v Meredith Whittaker>Und nicht jeder, ich glaube, war equating die growth und monetary success of

00:47:44.628 --> 00:47:49.908
<v Meredith Whittaker>the US-based tech industry with sort of, you know, values of social progress.

00:47:50.108 --> 00:47:52.908
<v Meredith Whittaker>I mean, I think we can, yeah, yes, it was liberal and then we can get back to

00:47:52.908 --> 00:47:56.928
<v Meredith Whittaker>a critique of liberalism and what have you, but it was, I think there were people

00:47:56.928 --> 00:47:58.368
<v Meredith Whittaker>who were looking at the infrastructure,

00:47:58.988 --> 00:48:02.888
<v Meredith Whittaker>who were looking at its capabilities, who were looking at the gap between the

00:48:02.888 --> 00:48:07.488
<v Meredith Whittaker>promises and the reality of what this tech did and calling that out.

00:48:07.508 --> 00:48:13.248
<v Meredith Whittaker>And I feel like, you know, when I entered into this kind of,

00:48:13.248 --> 00:48:18.108
<v Meredith Whittaker>Privacy, security, hacker development scene.

00:48:19.298 --> 00:48:22.258
<v Meredith Whittaker>There was a lot of that skepticism there around Google.

00:48:22.638 --> 00:48:26.338
<v Meredith Whittaker>That educated me a lot. There was a lot of skepticism around surveillance.

00:48:26.498 --> 00:48:31.178
<v Meredith Whittaker>I immediately recognized, yes, we need privacy because it doesn't matter if

00:48:31.178 --> 00:48:32.818
<v Meredith Whittaker>these people are good or benevolent.

00:48:33.198 --> 00:48:36.578
<v Meredith Whittaker>What we're doing is setting up an infrastructure that could be turned over at

00:48:36.578 --> 00:48:40.838
<v Meredith Whittaker>any moment to another regime. Logically, all of that made sense.

00:48:41.318 --> 00:48:46.658
<v Meredith Whittaker>But I don't feel that until the Snowden revelations, any of that was anywhere

00:48:46.658 --> 00:48:49.418
<v Meredith Whittaker>near in the nervous system of a kind of tech consciousness.

00:48:50.398 --> 00:48:56.338
<v Meredith Whittaker>And a lot of the work I've spent in the 1990s trying to sift through the crypto

00:48:56.338 --> 00:49:02.038
<v Meredith Whittaker>wars and sift through what happened with tech regulation to set up these surveillance

00:49:02.038 --> 00:49:05.458
<v Meredith Whittaker>giants and to permit this monopoly platform business model,

00:49:06.098 --> 00:49:12.618
<v Meredith Whittaker>has kind of looked at that gap between the rhetoric of liberal rights preserving.

00:49:13.618 --> 00:49:17.358
<v Meredith Whittaker>Open, free tech, and what was actually being built, right?

00:49:17.358 --> 00:49:22.038
<v Meredith Whittaker>And one of the things, if you look at, there's a scholar named Katharina Ryder,

00:49:22.258 --> 00:49:26.798
<v Meredith Whittaker>who I would really suggest, for show notes, I can send some of these links.

00:49:27.358 --> 00:49:32.378
<v Meredith Whittaker>But she did her dissertation looking at some of the negotiations in the crypto wars.

00:49:32.618 --> 00:49:36.338
<v Meredith Whittaker>And what you begin to see is that, yeah, we, you know, and this is a thesis

00:49:36.338 --> 00:49:38.698
<v Meredith Whittaker>sort of I build on top of in some of my work.

00:49:39.058 --> 00:49:42.078
<v Meredith Whittaker>Yeah, we won liberalized encryption, right?

00:49:42.078 --> 00:49:51.918
<v Meredith Whittaker>By 1999 in the US, it was finally legal to build, share, implement strong cryptosystems

00:49:51.918 --> 00:49:56.058
<v Meredith Whittaker>without approval from the government, without some threshold that made them useless.

00:49:57.538 --> 00:50:01.878
<v Meredith Whittaker>But the agreement there was basically, yeah, you can have encryption,

00:50:01.878 --> 00:50:06.878
<v Meredith Whittaker>but we're going to permit mass surveillance by companies.

00:50:06.878 --> 00:50:10.498
<v Meredith Whittaker>Und so you don't actually, like, you can just get the, you know,

00:50:10.638 --> 00:50:14.138
<v Meredith Whittaker>we're going to permit, we're going to endorse the advertising business model.

00:50:14.378 --> 00:50:19.678
<v Meredith Whittaker>We're going to endorse, and I can actually, I can start this point over, actually.

00:50:19.858 --> 00:50:22.318
<v Linus Neumann>Would you say those two decisions were...

00:50:25.714 --> 00:50:29.894
<v Linus Neumann>Strategically interlinked or were they just coinciding?

00:50:30.334 --> 00:50:35.194
<v Meredith Whittaker>I can't say that there was a conspiracy. What I can say is that Katarina's work

00:50:35.194 --> 00:50:41.374
<v Meredith Whittaker>shows that Microsoft saying liberalize encryption, don't worry we're not going

00:50:41.374 --> 00:50:43.094
<v Meredith Whittaker>to encrypt all the data, we need it.

00:50:44.234 --> 00:50:47.594
<v Meredith Whittaker>Just come to us quietly and we'll give it to you.

00:50:48.894 --> 00:50:54.314
<v Meredith Whittaker>Instead of fighting over a backdoor, instead of doing this in sort of the public

00:50:54.314 --> 00:50:58.194
<v Meredith Whittaker>domain where we're kind of losing the fight on technical and other grounds.

00:50:59.614 --> 00:51:05.894
<v Meredith Whittaker>Allow companies free reign to surveil because that allows us to implement this

00:51:05.894 --> 00:51:07.174
<v Meredith Whittaker>ad-supported business model.

00:51:07.854 --> 00:51:11.254
<v Meredith Whittaker>And then the data agreements can happen behind the scene.

00:51:11.434 --> 00:51:17.094
<v Meredith Whittaker>Now, I've like completely compressed a very complex history into basically a meme.

00:51:17.234 --> 00:51:22.874
<v Meredith Whittaker>But I think the purpose is there is that there was always that gap between these

00:51:22.874 --> 00:51:25.454
<v Meredith Whittaker>sort of rhetoric and what was actually going on.

00:51:25.614 --> 00:51:30.994
<v Meredith Whittaker>And I think the, I don't know, like there's like a kind of internet people, right?

00:51:31.174 --> 00:51:35.994
<v Meredith Whittaker>This type maybe misunderstood exactly like how this, you know,

00:51:36.094 --> 00:51:38.554
<v Meredith Whittaker>who would have power over this technology, right?

00:51:38.614 --> 00:51:43.094
<v Meredith Whittaker>Like encryption is liberalized, but it's not gonna be applied to protect personal

00:51:43.094 --> 00:51:45.934
<v Meredith Whittaker>communication. It's applied to protect transactions, right?

00:51:46.114 --> 00:51:50.754
<v Meredith Whittaker>It's not, you know, like the people who get to choose whether or not it's used aren't us.

00:51:51.614 --> 00:51:55.314
<v Meredith Whittaker>In terms of, you know, actually this sort of mass infrastructure in terms of

00:51:55.314 --> 00:51:59.514
<v Meredith Whittaker>the tech ecosystem that's being built by the actors who are calibrating their

00:51:59.514 --> 00:52:03.934
<v Meredith Whittaker>decisions based on the surveillance business model that has been instantiated right,

00:52:04.174 --> 00:52:07.194
<v Meredith Whittaker>you know, through regulatory decisions made by the Clinton administration.

00:52:07.194 --> 00:52:14.654
<v Linus Neumann>So then there were a couple of hundreds of thousands of nerds worldwide that used PGP encryption,

00:52:16.374 --> 00:52:22.094
<v Linus Neumann>using additional software and plugins to send an email with nonsense information

00:52:22.094 --> 00:52:27.514
<v Linus Neumann>to avoid government or private sector surveillance.

00:52:27.514 --> 00:52:33.894
<v Linus Neumann>But it was probably never really a significant number of individuals that...

00:52:36.240 --> 00:52:40.420
<v Linus Neumann>That got to the point of, you know, having mass encryption out there.

00:52:40.740 --> 00:52:45.760
<v Meredith Whittaker>Yeah, well, I tried. It's just that my friend group didn't overlap exactly with

00:52:45.760 --> 00:52:49.100
<v Meredith Whittaker>those couple of thousand nerds. So what am I going to do, right?

00:52:49.280 --> 00:52:52.240
<v Meredith Whittaker>And I think that's, you know, this is the network effect. This is why it's actually

00:52:52.240 --> 00:52:53.600
<v Meredith Whittaker>very difficult to do that.

00:52:53.660 --> 00:52:57.700
<v Meredith Whittaker>And this is why if one of those actors that controls these infrastructures doesn't

00:52:57.700 --> 00:53:01.660
<v Meredith Whittaker>make the choice for us, it's really difficult to make that choice.

00:53:01.760 --> 00:53:06.160
<v Linus Neumann>And none of these actors voluntarily got the idea, right? I think it's part

00:53:06.160 --> 00:53:12.480
<v Linus Neumann>of the founding myth of Signal that Moxie at the time wanted to implement the,

00:53:13.180 --> 00:53:14.480
<v Linus Neumann>it's now called the Signal Protocol.

00:53:14.500 --> 00:53:17.760
<v Linus Neumann>I still remember it as being Axolotl or whatever it was called.

00:53:17.840 --> 00:53:21.000
<v Meredith Whittaker>It used to be Axolotl. And then it was when Signal was launched,

00:53:21.140 --> 00:53:28.420
<v Meredith Whittaker>which was the Red Phone Tech Secure integrated into one app for iOS in 2013. It was changed.

00:53:28.600 --> 00:53:34.660
<v Linus Neumann>Right. But initially, I believe Moxie wanted to implement at Crypto for Twitter,

00:53:35.300 --> 00:53:38.600
<v Linus Neumann>direct messages, if I'm not mistaken. I think it was at Twitter before.

00:53:39.220 --> 00:53:43.580
<v Linus Neumann>And so his idea to roll out Twitter,

00:53:44.755 --> 00:53:50.995
<v Linus Neumann>Definitely, he devoted a few years of his life to implementing and rolling out

00:53:50.995 --> 00:53:52.555
<v Linus Neumann>mass end-to-end encryption, right?

00:53:53.175 --> 00:53:56.615
<v Linus Neumann>But I believe it was he wanted to do it at Twitter at the time.

00:53:56.775 --> 00:54:02.395
<v Linus Neumann>And maybe I'm wrong here, then our listeners will correct me two minutes into the show.

00:54:04.335 --> 00:54:06.795
<v Linus Neumann>But clearly, none of the large...

00:54:06.795 --> 00:54:11.415
<v Meredith Whittaker>And I don't actually know for sure that story, so don't correct me.

00:54:11.895 --> 00:54:12.915
<v Linus Neumann>It's my mistake.

00:54:14.615 --> 00:54:21.135
<v Tim Pritlove>Ich habe einen anderen Punkt, aber ich denke, dass Twitter nicht sich als eine

00:54:21.135 --> 00:54:22.415
<v Tim Pritlove>Messergebung und eine Messergebung und eine Messergebung was,

00:54:22.415 --> 00:54:24.975
<v Tim Pritlove>was wahrscheinlich ein Mistake von der Ich meine.

00:54:25.015 --> 00:54:29.095
<v Meredith Whittaker>Und der Regulatory Issues. Ja. Ich meine, ich habe mich mit der Security Team

00:54:29.095 --> 00:54:30.795
<v Meredith Whittaker>und da waren immer diese Ideen,

00:54:30.835 --> 00:54:38.175
<v Meredith Whittaker>ich habe immer ein Projekt wo wir uns an die Keystore für andere Services und

00:54:38.175 --> 00:54:42.035
<v Meredith Whittaker>du hast diese wirklich exciting conversations mit den Security Guys and then

00:54:42.035 --> 00:54:45.095
<v Meredith Whittaker>it wouldn't go anywhere because then, you know, the other guys would get involved.

00:54:47.395 --> 00:54:51.115
<v Linus Neumann>Point I was trying to make is none of the big platforms ever rolled out mass

00:54:51.115 --> 00:54:53.955
<v Linus Neumann>scale end-to-end encryption until eventually WhatsApp did.

00:54:54.155 --> 00:55:01.995
<v Linus Neumann>And it took an Edward Snowden revelations and an ongoing scanner for I think

00:55:01.995 --> 00:55:07.895
<v Linus Neumann>roughly one year until Facebook at the time said, okay, we'll implement this.

00:55:08.395 --> 00:55:13.275
<v Meredith Whittaker>Well, actually, I mean, that's, So Signal existed before the WhatsApp integration.

00:55:13.455 --> 00:55:13.615
<v Linus Neumann>Sure.

00:55:14.375 --> 00:55:19.435
<v Meredith Whittaker>And the WhatsApp integration was driven by Brian and Jan, who are the co-founders.

00:55:19.895 --> 00:55:23.375
<v Meredith Whittaker>And my understanding there is that they were rushing to get that done before

00:55:23.375 --> 00:55:27.935
<v Meredith Whittaker>the Facebook integration, to make sure that they weren't selling something that

00:55:27.935 --> 00:55:29.975
<v Meredith Whittaker>would violate their principles.

00:55:30.675 --> 00:55:34.275
<v Meredith Whittaker>And I know Moxie was working on that. I remember that period of time.

00:55:34.275 --> 00:55:39.495
<v Meredith Whittaker>Und dann Facebook bought it.

00:55:39.695 --> 00:55:49.575
<v Meredith Whittaker>Und ich weiß nicht, dass die deal da ist, aber es bleibt, mit der Signals-Protokolle.

00:55:51.595 --> 00:55:55.555
<v Meredith Whittaker>Es war ein Post-Snowden Moment.

00:55:55.695 --> 00:55:59.735
<v Meredith Whittaker>Du sahst Android und iOS implementiert Full Disk Encryption.

00:55:59.735 --> 00:56:04.415
<v Meredith Whittaker>Du sahst Google encrypting. its.

00:56:06.555 --> 00:56:12.255
<v Meredith Whittaker>HTPS for its networks and I think a lot of this was just like we need to distance

00:56:12.255 --> 00:56:17.455
<v Meredith Whittaker>ourselves from bad government spying by adding encryption that proves that we're

00:56:17.455 --> 00:56:20.715
<v Meredith Whittaker>not actually part of the problem that they have just sort of,

00:56:21.355 --> 00:56:26.335
<v Meredith Whittaker>the bad government has attacked us as taxpaying corporations,

00:56:26.335 --> 00:56:30.515
<v Meredith Whittaker>taken this data that we really want to protect but god how could we have known

00:56:30.515 --> 00:56:32.915
<v Meredith Whittaker>and so now we're encrypting things and,

00:56:34.205 --> 00:56:39.725
<v Meredith Whittaker>ultimately good, right? But it was a way of not looking at the full story of

00:56:39.725 --> 00:56:41.405
<v Meredith Whittaker>like, why is that there to begin with?

00:56:42.225 --> 00:56:47.025
<v Meredith Whittaker>And what else is not being encrypted? What other data is being given over?

00:56:47.205 --> 00:56:53.245
<v Meredith Whittaker>And why do you have the choice to do that to begin with instead of a more socially

00:56:53.245 --> 00:56:55.445
<v Meredith Whittaker>beneficial, democratic process

00:56:55.445 --> 00:56:58.645
<v Meredith Whittaker>of determining how we're comfortable with technology entering our lives?

00:56:58.785 --> 00:57:04.765
<v Linus Neumann>I probably would have even had an even better or even stronger perspective on

00:57:04.765 --> 00:57:09.785
<v Linus Neumann>it seems like the governments didn't really attack these corporations.

00:57:09.985 --> 00:57:14.365
<v Linus Neumann>The governments made their business model look bad. So now they needed to change

00:57:14.365 --> 00:57:17.745
<v Linus Neumann>something to convince people no, no, no, your data is safe here.

00:57:17.985 --> 00:57:21.225
<v Linus Neumann>We'll encrypt something and moving on, moving on.

00:57:21.965 --> 00:57:27.225
<v Meredith Whittaker>I was, for the gentle listener, I was kind of joking because that rhetoric around

00:57:27.225 --> 00:57:34.045
<v Meredith Whittaker>being attacked and being like, oh my gosh, was Very much the mood at that time.

00:57:34.365 --> 00:57:39.785
<v Meredith Whittaker>I was at Google when Snowden dropped and I remember just things popped off and

00:57:39.785 --> 00:57:42.045
<v Meredith Whittaker>I actually had to get, I got on a plane.

00:57:42.405 --> 00:57:46.005
<v Meredith Whittaker>I don't know, you all probably have a memory similar to me of like when the

00:57:46.005 --> 00:57:50.105
<v Meredith Whittaker>Guardian stories with the Verizon water, like the Glenn Greenwald stories.

00:57:50.265 --> 00:57:54.625
<v Meredith Whittaker>It was night in New York. It was probably morning the next day you guys saw

00:57:54.625 --> 00:57:57.405
<v Meredith Whittaker>it. I remember sitting on my couch and being like, holy fuck.

00:57:57.765 --> 00:58:01.005
<v Meredith Whittaker>And realizing just how big that was because it was the kind of thing we'd been

00:58:01.005 --> 00:58:05.285
<v Meredith Whittaker>talking about, speculating about in the rooms that you and I were in, Linus.

00:58:05.505 --> 00:58:07.925
<v Meredith Whittaker>And then it was like, oh, receipts, shit.

00:58:08.305 --> 00:58:12.125
<v Meredith Whittaker>And there was a lot of unclarity. There was that Prism slide where it was like,

00:58:12.185 --> 00:58:16.165
<v Meredith Whittaker>is Google just giving them full access? That people were rioting inside.

00:58:16.665 --> 00:58:18.365
<v Meredith Whittaker>Security engineers were threatening to quit.

00:58:18.885 --> 00:58:21.605
<v Meredith Whittaker>And then that morning I got on a plane to TorDev.

00:58:25.465 --> 00:58:27.745
<v Meredith Whittaker>And so, yeah, in Berlin, actually.

00:58:29.705 --> 00:58:33.885
<v Linus Neumann>I remember that this time,

00:58:34.185 --> 00:58:40.545
<v Linus Neumann>and we at CCC really had to bite our tongue and write a media communications

00:58:40.545 --> 00:58:44.905
<v Linus Neumann>strategy and said, nobody says I told you so.

00:58:45.265 --> 00:58:51.965
<v Linus Neumann>We need to at least act surprised as well, right? And not say,

00:58:52.065 --> 00:58:53.045
<v Linus Neumann>well, we told you all along.

00:58:55.005 --> 00:58:57.965
<v Meredith Whittaker>I give you all a pass, because you did tell us all along.

00:58:59.805 --> 00:59:05.805
<v Linus Neumann>But of course it gave a lot of international media attention to our cause.

00:59:05.965 --> 00:59:10.965
<v Linus Neumann>And we needed to play that public attention wisely.

00:59:11.345 --> 00:59:11.605
<v Meredith Whittaker>Exactly.

00:59:12.925 --> 00:59:14.765
<v Linus Neumann>I think we maybe did.

00:59:15.285 --> 00:59:22.325
<v Tim Pritlove>I find it quite interesting how encryption as a topic has changed over time. It's just...

00:59:23.132 --> 00:59:28.712
<v Tim Pritlove>More or less 10 years ago that Facebook actually changed to HTTPS on their website by default.

00:59:29.332 --> 00:59:34.952
<v Tim Pritlove>And so there was a time not so long ago, you know, where most of the data was

00:59:34.952 --> 00:59:38.572
<v Tim Pritlove>flowing around on the Internet, mostly unencrypted.

00:59:38.812 --> 00:59:43.472
<v Tim Pritlove>And that although there was these already mentioned crypto wars,

00:59:43.632 --> 00:59:47.432
<v Tim Pritlove>you know, about general encryption, but it was also always for nerds and for

00:59:47.432 --> 00:59:49.352
<v Tim Pritlove>specific applications.

00:59:49.352 --> 00:59:56.732
<v Tim Pritlove>Then it also got this nice paint with this whole cryptocurrency craze going

00:59:56.732 --> 01:00:02.312
<v Tim Pritlove>on, which made it somehow popular and almost took the word away.

01:00:02.792 --> 01:00:03.592
<v Meredith Whittaker>We're so wrestling.

01:00:05.512 --> 01:00:13.772
<v Tim Pritlove>And it was also the rise of encrypted messaging that was really giving a new fuel.

01:00:14.052 --> 01:00:17.772
<v Tim Pritlove>So Signal was in the middle of all of this, as we already heard.

01:00:17.772 --> 01:00:26.092
<v Tim Pritlove>So, I'd like to focus on Signal for a moment as an organization that you now head.

01:00:27.532 --> 01:00:29.832
<v Tim Pritlove>What's your understanding of

01:00:29.832 --> 01:00:36.612
<v Tim Pritlove>what Signal is and what it's not and how the organization deals with it?

01:00:37.932 --> 01:00:43.212
<v Meredith Whittaker>Well, I love Signal and I'm really...

01:00:44.132 --> 01:00:49.812
<v Meredith Whittaker>Yeah, it's the only cool tech company in my view. Und ich denke...

01:00:51.616 --> 01:00:54.916
<v Meredith Whittaker>So boiling down, like what is Signal in one word is a little,

01:00:55.396 --> 01:00:58.656
<v Meredith Whittaker>you know, I'll just, I'll start somewhere and we'll end another place because

01:00:58.656 --> 01:01:01.996
<v Meredith Whittaker>I think it's actually, it's a number of things and kind of represents even more.

01:01:03.396 --> 01:01:09.056
<v Meredith Whittaker>You know, Signal started back, you know, the late 2000s, right?

01:01:09.176 --> 01:01:11.436
<v Meredith Whittaker>And we can, you know, we can date it to whenever, right?

01:01:11.616 --> 01:01:16.236
<v Meredith Whittaker>Signal as the integrated app was 2013, but your Red Phone, TextSecure predated that.

01:01:17.056 --> 01:01:20.476
<v Meredith Whittaker>And this is, you know, there's no iPhone.

01:01:22.456 --> 01:01:27.556
<v Meredith Whittaker>Jabber is the competition, right? It's like web client-based chat.

01:01:27.996 --> 01:01:31.556
<v Meredith Whittaker>There's no, you know, people aren't carrying smartphones. There isn't,

01:01:32.016 --> 01:01:33.156
<v Meredith Whittaker>WhatsApp doesn't exist.

01:01:33.796 --> 01:01:38.216
<v Meredith Whittaker>IMessage doesn't exist. You have a very, very different marketplace.

01:01:38.436 --> 01:01:42.516
<v Tim Pritlove>Were there still ICQ and AIM, I think, at the time?

01:01:42.916 --> 01:01:48.216
<v Meredith Whittaker>Yeah, yeah. I mean, I remember using, like, I don't remember,

01:01:48.456 --> 01:01:53.556
<v Meredith Whittaker>I'd like send text messages sometimes, but they were expensive on my BlackBerry, maybe.

01:01:55.356 --> 01:01:59.196
<v Meredith Whittaker>But we're talking about a drastically different tech ecosystem.

01:01:59.196 --> 01:02:03.436
<v Meredith Whittaker>And this is particularly important in the context of messaging and communications apps.

01:02:03.656 --> 01:02:07.636
<v Meredith Whittaker>Because, of course, you need a network effect for those to work.

01:02:07.756 --> 01:02:12.116
<v Meredith Whittaker>No one buys the first telephone because you can't use one telephone.

01:02:12.116 --> 01:02:13.596
<v Meredith Whittaker>Your friend has to have a telephone.

01:02:14.116 --> 01:02:16.796
<v Meredith Whittaker>All your friends have to have an app if you're going to use it.

01:02:16.916 --> 01:02:21.156
<v Meredith Whittaker>Particularly, it takes two to encrypt. Group encryption, it takes everyone in the group.

01:02:21.916 --> 01:02:29.096
<v Meredith Whittaker>And if everyone isn't using your app for communication, it's very different

01:02:29.096 --> 01:02:32.016
<v Meredith Whittaker>in a saturated marketplace where you have WhatsApp,

01:02:32.216 --> 01:02:35.716
<v Meredith Whittaker>where you have iMessage, where you have these normative models that people go

01:02:35.716 --> 01:02:40.376
<v Meredith Whittaker>to just to have their regular communication to introduce a new platform.

01:02:42.230 --> 01:02:45.270
<v Meredith Whittaker>For secure messaging or insecure messaging, right?

01:02:45.350 --> 01:02:49.130
<v Meredith Whittaker>Because people don't switch outside of the network unless their friends switch

01:02:49.130 --> 01:02:52.210
<v Meredith Whittaker>outside of the network and there's a collective action problem there and an

01:02:52.210 --> 01:02:54.250
<v Meredith Whittaker>inertia problem there and all of that, right?

01:02:54.710 --> 01:02:59.130
<v Meredith Whittaker>So when I think about, there's many things that are very precious about Signal,

01:02:59.350 --> 01:03:05.030
<v Meredith Whittaker>but the fact that Moxie carried it on his back for that decade and was actually

01:03:05.030 --> 01:03:09.410
<v Meredith Whittaker>able to keep it going and surviving without selling out,

01:03:09.610 --> 01:03:14.790
<v Meredith Whittaker>without selling data and actually creating something that is now able to scale

01:03:14.790 --> 01:03:17.370
<v Meredith Whittaker>to hundreds of millions of people.

01:03:19.130 --> 01:03:25.930
<v Meredith Whittaker>Means that Signal actually has a position in this ecosystem that makes it useful to people.

01:03:26.050 --> 01:03:32.230
<v Meredith Whittaker>That means that it's actually providing encrypted communication to people all

01:03:32.230 --> 01:03:35.650
<v Meredith Whittaker>over the globe because their friends are using it.

01:03:35.870 --> 01:03:40.490
<v Meredith Whittaker>And my contention here, and I'm willing to discuss this, I don't think we can

01:03:40.490 --> 01:03:42.130
<v Meredith Whittaker>recreate Signal, right?

01:03:42.230 --> 01:03:45.850
<v Meredith Whittaker>You could shift, you know, because it has that user base, right?

01:03:46.290 --> 01:03:50.290
<v Meredith Whittaker>You can introduce a new app, but how do you get people to use it without an

01:03:50.290 --> 01:03:54.390
<v Meredith Whittaker>OEM, without an existing installed user base, without some way of,

01:03:54.550 --> 01:03:57.330
<v Meredith Whittaker>you know, kind of making it useful to people?

01:03:57.790 --> 01:04:01.690
<v Meredith Whittaker>Because again, it's, you know, one telephone or, you know, a couple thousand

01:04:01.690 --> 01:04:05.810
<v Meredith Whittaker>hackers who all use PGP, but they can't talk to their dad on PGP, right?

01:04:05.850 --> 01:04:10.970
<v Meredith Whittaker>They can't talk to anyone outside of themselves on PGP. So Signal has both sort

01:04:10.970 --> 01:04:15.150
<v Meredith Whittaker>of kept this form that is very heterodox in tech.

01:04:15.470 --> 01:04:20.150
<v Meredith Whittaker>It's a nonprofit, so I couldn't really sell out profitably.

01:04:20.270 --> 01:04:22.510
<v Meredith Whittaker>I could try to sell out, but I'm not going to get any money from it.

01:04:22.610 --> 01:04:27.590
<v Meredith Whittaker>It has to be reinvested in the mission, and there are certain rules around mission alignment there.

01:04:27.650 --> 01:04:33.030
<v Meredith Whittaker>So we're not pressured to monetize surveillance or to collect any data.

01:04:33.030 --> 01:04:38.590
<v Meredith Whittaker>We're really able to stay focused on that mission and in an ecosystem where.

01:04:39.918 --> 01:04:44.158
<v Meredith Whittaker>The diametric opposite is the norm. That's really, really important,

01:04:45.018 --> 01:04:48.478
<v Meredith Whittaker>irrespective about the flaws of the nonprofit model more generally.

01:04:49.578 --> 01:04:54.638
<v Meredith Whittaker>So it's achieved this pretty rare, like it's the only thing like it in the ecosystem.

01:04:54.838 --> 01:05:04.598
<v Meredith Whittaker>And I think it also serves as a model for how we could think about building tech differently.

01:05:04.598 --> 01:05:11.938
<v Meredith Whittaker>Like, how do we disarm, deconstruct the massive centralized power of a handful

01:05:11.938 --> 01:05:15.258
<v Meredith Whittaker>of platform companies that basically control most of the infrastructure and

01:05:15.258 --> 01:05:18.558
<v Meredith Whittaker>information ecosystem in our world and our jurisdiction in the US?

01:05:18.938 --> 01:05:24.398
<v Meredith Whittaker>And how do we build other models that may be interoperable, that are more open,

01:05:24.698 --> 01:05:28.698
<v Meredith Whittaker>that are more rights preserving, and that aren't subject to the pressures of

01:05:28.698 --> 01:05:30.938
<v Meredith Whittaker>and incentives of the surveillance business model?

01:05:30.938 --> 01:05:35.778
<v Linus Neumann>Now, I find it interesting, you mentioned the network effect that for a long

01:05:35.778 --> 01:05:40.378
<v Linus Neumann>time worked against you, right? You said, okay, it took Moxie a decade.

01:05:42.738 --> 01:05:48.678
<v Linus Neumann>Now, that network effect, you know, the EU regulatory bodies have an idea on

01:05:48.678 --> 01:05:52.938
<v Linus Neumann>how to weaken it by enabling messenger interoperability,

01:05:54.858 --> 01:06:00.838
<v Linus Neumann>Thus, pretty much trying to force the large messenger operators,

01:06:01.098 --> 01:06:08.658
<v Linus Neumann>be it WhatsApp or whatever else people use, to offer an interoperability interface.

01:06:08.658 --> 01:06:17.718
<v Linus Neumann>So any new messenger would have it easier than Signal did to reach the critical,

01:06:18.578 --> 01:06:23.218
<v Linus Neumann>amount of users to actually have the network effect.

01:06:23.438 --> 01:06:30.238
<v Linus Neumann>Now I know Signal's position strongly opposes this idea or you decided not to

01:06:30.238 --> 01:06:34.778
<v Linus Neumann>participate in this interoperability or making use of it.

01:06:36.478 --> 01:06:37.638
<v Linus Neumann>There are two.

01:06:40.003 --> 01:06:45.503
<v Linus Neumann>Forces or two goals of Signal, I guess, that contradict each other here,

01:06:45.703 --> 01:06:49.383
<v Linus Neumann>and that is its security and building open communication systems.

01:06:51.183 --> 01:06:56.323
<v Linus Neumann>Maybe you can explain a little bit why, after, you know, having understood how

01:06:56.323 --> 01:07:02.263
<v Linus Neumann>hard it is to build Signal and, you know, against a market, why you would still

01:07:02.263 --> 01:07:05.083
<v Linus Neumann>oppose messenger interoperability.

01:07:05.483 --> 01:07:11.683
<v Meredith Whittaker>Yeah, I like this question because I'm going to, I want to clarify our position,

01:07:12.003 --> 01:07:16.163
<v Meredith Whittaker>which is a little bit of nuance.

01:07:19.923 --> 01:07:24.263
<v Meredith Whittaker>I don't oppose interoperability in principle.

01:07:24.583 --> 01:07:31.023
<v Meredith Whittaker>Like if the interoperability mandate of the DSA were, you all have to,

01:07:31.263 --> 01:07:38.143
<v Meredith Whittaker>you know, interoperability needs to be an option and it has to happen at this rigorous security bar.

01:07:38.303 --> 01:07:46.063
<v Meredith Whittaker>You have to make sure that you're implementing metadata security, sealed sender.

01:07:46.203 --> 01:07:48.323
<v Meredith Whittaker>Basically, you're adopting the

01:07:48.323 --> 01:07:54.623
<v Meredith Whittaker>signal privacy and security bar as the conditions for interoperability.

01:07:56.024 --> 01:08:00.224
<v Meredith Whittaker>That would be really cool, right? And I think that's the issue here.

01:08:00.344 --> 01:08:03.784
<v Meredith Whittaker>I mean, and I want to put an asterisk here for a moment saying,

01:08:03.904 --> 01:08:06.204
<v Meredith Whittaker>like, there are a lot of other complexities around policy.

01:08:06.424 --> 01:08:12.564
<v Meredith Whittaker>Like, you know, how do you take in a, you know, who deals with a law enforcement request, right?

01:08:13.144 --> 01:08:16.624
<v Meredith Whittaker>Even if you have no data to give them, you can't just ignore that.

01:08:16.804 --> 01:08:20.324
<v Meredith Whittaker>You know, like, if a user has a complaint, who do they write in?

01:08:21.124 --> 01:08:25.424
<v Meredith Whittaker>If you're interoperating with a platform for communication that also has a social

01:08:25.424 --> 01:08:29.724
<v Meredith Whittaker>media arm, there's a totally different regulatory environment for Telegram or

01:08:29.724 --> 01:08:31.984
<v Meredith Whittaker>WhatsApp with channels than for a signal.

01:08:32.284 --> 01:08:35.024
<v Meredith Whittaker>How does that sort of work?

01:08:35.904 --> 01:08:38.004
<v Meredith Whittaker>So I want to say this isn't simple.

01:08:38.204 --> 01:08:39.104
<v Linus Neumann>It's a whole can of worms.

01:08:39.264 --> 01:08:45.304
<v Meredith Whittaker>There's a massive can of worms as the EU often opens. Um, but the,

01:08:45.464 --> 01:08:49.024
<v Meredith Whittaker>you know, like the conditions of interoperability are actually really,

01:08:49.304 --> 01:08:51.664
<v Meredith Whittaker>you know, they're really political here. Right.

01:08:51.884 --> 01:08:59.204
<v Meredith Whittaker>So in order to interoperate with WhatsApp, am I going to be giving signal user data to Meta?

01:08:59.724 --> 01:09:04.224
<v Meredith Whittaker>Well, that would violate the entire premise of what I'm spending my life's energy

01:09:04.224 --> 01:09:05.904
<v Meredith Whittaker>doing and Signal, right?

01:09:06.304 --> 01:09:11.344
<v Meredith Whittaker>Is Meta going to decide to, you know, cut off the account of one of our users?

01:09:11.524 --> 01:09:15.124
<v Meredith Whittaker>Who gets to decide that, right? Are they, you know, are they collecting,

01:09:15.144 --> 01:09:20.184
<v Meredith Whittaker>you know, other data because they aren't implementing some of our libraries or whatever?

01:09:20.404 --> 01:09:23.204
<v Meredith Whittaker>And so I think, you know, that's where the rubber meets the road.

01:09:23.584 --> 01:09:27.344
<v Meredith Whittaker>And we have to have a duty of care to the people who rely on Signal.

01:09:27.344 --> 01:09:32.464
<v Meredith Whittaker>Das heißt, wir sind absolut nicht going zu verabschieden, dass wir wissen,

01:09:32.664 --> 01:09:39.504
<v Meredith Whittaker>wenn wir real sind, dass es eine Frau in der Jäule in den USA ist,

01:09:39.584 --> 01:09:44.224
<v Meredith Whittaker>weil Meta in den Facebook-Messagen hat, zwischen ihr und ihr daughter,

01:09:44.364 --> 01:09:46.644
<v Meredith Whittaker>die sie überprüfen hat, dass sie sie erhalten,

01:09:47.524 --> 01:09:50.704
<v Meredith Whittaker>in der Stadt von Nebraska, nach dem Dobbs-Dobbs-Dobbs-Dobbs-Dobbs.

01:09:52.198 --> 01:09:56.878
<v Meredith Whittaker>That's the stakes of this conversation, even when we're talking about the technical

01:09:56.878 --> 01:09:59.138
<v Meredith Whittaker>details of interoperability, right?

01:09:59.498 --> 01:10:03.358
<v Linus Neumann>Dobbs' decision is reverting Roe v. Wade, right?

01:10:03.998 --> 01:10:04.218
<v Meredith Whittaker>Yeah.

01:10:04.678 --> 01:10:09.638
<v Linus Neumann>Okay, so just for some of the listeners that are not that much into the US policy.

01:10:09.778 --> 01:10:11.098
<v Tim Pritlove>Basically outlawing abortion.

01:10:11.358 --> 01:10:13.818
<v Linus Neumann>Allowing states to outlaw abortion.

01:10:14.058 --> 01:10:19.878
<v Meredith Whittaker>Access to life-saving healthcare that more than half the population may need.

01:10:21.278 --> 01:10:26.138
<v Linus Neumann>So your answer in short is interoperability is fine,

01:10:26.338 --> 01:10:33.658
<v Linus Neumann>but you do not see any path currently being debated that would result in upholding

01:10:33.658 --> 01:10:41.198
<v Linus Neumann>the security promises that Signal has worked long for to be able to make to its user base.

01:10:41.938 --> 01:10:45.938
<v Meredith Whittaker>We will continue to advocate for a path that raises that bar,

01:10:46.218 --> 01:10:49.998
<v Meredith Whittaker>meets or exceeds Signal's bar. And if it succeeds, I'm like,

01:10:50.258 --> 01:10:51.638
<v Meredith Whittaker>yeah, I want to talk about that.

01:10:53.218 --> 01:10:56.938
<v Meredith Whittaker>But, you know, those are the conditions under which we would interoperate.

01:10:57.098 --> 01:10:59.378
<v Meredith Whittaker>So we're not, you know, we don't take a stand against it.

01:10:59.618 --> 01:11:03.638
<v Meredith Whittaker>You know, we just say like, look, these are the complexities and this is,

01:11:04.558 --> 01:11:07.558
<v Meredith Whittaker>you know, Signal stands with the people who rely on Signal, not with a sort

01:11:07.558 --> 01:11:11.258
<v Meredith Whittaker>of, you know, vision for some muddy middle where we're all interoperating,

01:11:11.358 --> 01:11:14.738
<v Meredith Whittaker>but we've sort of, you know, sold people out and made them susceptible to,

01:11:14.918 --> 01:11:16.618
<v Meredith Whittaker>you know, what we describe with Meta.

01:11:17.298 --> 01:11:22.098
<v Tim Pritlove>Do people in the EU understand what you're talking about if you're offering

01:11:22.098 --> 01:11:25.118
<v Tim Pritlove>these technical explanations why it's complicated?

01:11:25.618 --> 01:11:28.398
<v Tim Pritlove>Because we have the impression that they don't really get it.

01:11:28.478 --> 01:11:29.798
<v Meredith Whittaker>Is this mean or median, people?

01:11:32.618 --> 01:11:35.698
<v Meredith Whittaker>I mean, I don't think most people don't understand this at all because they

01:11:35.698 --> 01:11:38.238
<v Meredith Whittaker>got laundry to do and this isn't their area, right?

01:11:38.478 --> 01:11:44.418
<v Meredith Whittaker>I think some of the politicians I've talked to seem to get it, but it's not...

01:11:47.620 --> 01:11:52.860
<v Meredith Whittaker>Ich denke, dass es eine Inertia über das Prozess ist, das bedeutet,

01:11:52.980 --> 01:11:57.680
<v Meredith Whittaker>dass es nicht klar, wie weit diese Punkte haben, die Bedrock zu haben, so zu sprechen.

01:11:59.000 --> 01:12:04.020
<v Meredith Whittaker>Ich würde auch, als Amerikaner, ich bin hier, für heute.

01:12:04.300 --> 01:12:12.060
<v Meredith Whittaker>Aber ich also habe, ich würde sagen, mein Instinkt auf die Generalentwicklung

01:12:12.060 --> 01:12:14.800
<v Meredith Whittaker>der EU ist nicht was ich, was ich rely auf.

01:12:14.800 --> 01:12:20.160
<v Tim Pritlove>Which brings me to an interesting point because we are actually very interested

01:12:20.160 --> 01:12:27.260
<v Tim Pritlove>in your view as an American knowing how things work on that continent,

01:12:28.200 --> 01:12:34.880
<v Tim Pritlove>What's your impression of how Europe deals with tech these new technologies

01:12:34.880 --> 01:12:46.440
<v Tim Pritlove>coming up and how it impacts society Can you just give me a feeling for how this is to you,

01:12:47.220 --> 01:12:49.260
<v Tim Pritlove>in a good way, in a bad way, whatever,

01:12:50.160 --> 01:12:52.300
<v Tim Pritlove>you feel just to...

01:12:52.300 --> 01:12:58.740
<v Meredith Whittaker>One meta-observation, having been here for a bit of duration now, is,

01:13:00.089 --> 01:13:06.489
<v Meredith Whittaker>And I've thought this before, but it's interesting to think of Europe as one thing.

01:13:07.889 --> 01:13:10.629
<v Meredith Whittaker>When you go to different countries and meet different people and you're like,

01:13:10.689 --> 01:13:13.369
<v Meredith Whittaker>wow, this is not one thing.

01:13:14.169 --> 01:13:16.029
<v Linus Neumann>I mean, that's the same in the US, right?

01:13:16.029 --> 01:13:19.329
<v Meredith Whittaker>It is in the US, yeah. I mean, you know, it's big.

01:13:19.789 --> 01:13:25.089
<v Tim Pritlove>But there is a common theme somehow. I'm just focusing on what you can probably

01:13:25.089 --> 01:13:29.589
<v Tim Pritlove>match to Europe in general. or at least to the kind of discussions you have

01:13:29.589 --> 01:13:32.949
<v Tim Pritlove>on a political level when you face EU institutions.

01:13:33.349 --> 01:13:36.969
<v Meredith Whittaker>It's almost, it's split in an interesting way.

01:13:37.329 --> 01:13:42.669
<v Meredith Whittaker>Because on one part, if you go to kind of the startup ecosystem,

01:13:43.049 --> 01:13:47.189
<v Meredith Whittaker>the VC ecosystem, like that world, there's a real,

01:13:47.849 --> 01:13:52.649
<v Meredith Whittaker>you know, there's a lot of smart people and cool people doing cool things.

01:13:52.849 --> 01:13:58.229
<v Meredith Whittaker>And there's sometimes a bit of magical thinking that I see, which is really like,

01:13:58.829 --> 01:14:02.689
<v Meredith Whittaker>you know, if we wish hard enough, if we're able to figure it out,

01:14:02.789 --> 01:14:06.609
<v Meredith Whittaker>we're going to be able to create competitors to the US incumbents,

01:14:06.869 --> 01:14:09.329
<v Meredith Whittaker>right? And we're going to have our own thing.

01:14:09.509 --> 01:14:10.569
<v Tim Pritlove>Own search engine.

01:14:12.949 --> 01:14:16.189
<v Meredith Whittaker>Which often just, you know, sometimes I'm just like, okay, that's a money play, right?

01:14:16.289 --> 01:14:19.309
<v Meredith Whittaker>Like, you get enough in, you know, your Series A, Series B, and then you'll

01:14:19.309 --> 01:14:22.169
<v Meredith Whittaker>get acquired, and no one will do anything with it, or you'll get rich, or whatever.

01:14:22.289 --> 01:14:27.109
<v Meredith Whittaker>You know, like, you may not necessarily believe that. Like, markets float on Hype.

01:14:27.929 --> 01:14:34.009
<v Meredith Whittaker>So, okay. But there is this thread where it's almost a willful misunderstanding

01:14:34.009 --> 01:14:40.629
<v Meredith Whittaker>of the reality of incumbent platforms, of the history that accrued that type

01:14:40.629 --> 01:14:42.289
<v Meredith Whittaker>of power to US companies,

01:14:42.409 --> 01:14:48.469
<v Meredith Whittaker>and of the dependencies that Europe and most of the rest of the world have on these companies.

01:14:49.429 --> 01:14:54.569
<v Meredith Whittaker>The three cloud companies based in the US have 70, 70% of the global market.

01:14:55.369 --> 01:14:58.029
<v Meredith Whittaker>You have five major social media platforms.

01:14:58.029 --> 01:14:59.269
<v Tim Pritlove>Amazon, Google and Microsoft.

01:14:59.629 --> 01:15:07.069
<v Meredith Whittaker>Yeah, AWS, Azure, GCP. And then I think the other percentage are made up by

01:15:07.069 --> 01:15:09.749
<v Meredith Whittaker>US companies as well. And then there's some Chinese companies.

01:15:10.569 --> 01:15:15.989
<v Meredith Whittaker>And then you have five platforms that effectively shape our global information

01:15:15.989 --> 01:15:18.749
<v Meredith Whittaker>ecosystem, like our perception of reality.

01:15:18.929 --> 01:15:22.149
<v Meredith Whittaker>The four biggest jurisdictions in the US, right?

01:15:22.489 --> 01:15:23.969
<v Tim Pritlove>Which five platforms?

01:15:26.069 --> 01:15:30.529
<v Meredith Whittaker>Das ist, was ich werde, ich werde, ich werde, vier haben, denn da ist immer eine Last in der Liste.

01:15:30.929 --> 01:15:35.889
<v Meredith Whittaker>So TikTok ist eine Non-U.S. one, und das ist die eine die Leute freigte aus, um, recently.

01:15:37.029 --> 01:15:38.489
<v Linus Neumann>Weil es ist Non-U.S.?

01:15:38.489 --> 01:15:41.669
<v Meredith Whittaker>Ja, ich denke, so flatly, ist es.

01:15:43.649 --> 01:15:46.989
<v Meredith Whittaker>Facebook, Instagram, X.

01:15:48.686 --> 01:15:53.446
<v Meredith Whittaker>Und dann, es ist nicht Twitch, aber irgendwie, da ist eine andere one auf YouTube.

01:15:55.786 --> 01:15:57.466
<v Meredith Whittaker>Und dann ist Twitch, too.

01:15:59.706 --> 01:16:02.866
<v Meredith Whittaker>Für all intents und purposes, das ist ein huge amount of concentrated power

01:16:02.866 --> 01:16:06.126
<v Meredith Whittaker>that, again, relies on network effects, relies on economies of scale,

01:16:06.326 --> 01:16:09.026
<v Meredith Whittaker>relies on all kinds of global infrastructure.

01:16:09.066 --> 01:16:17.086
<v Meredith Whittaker>It's trillions of dollars that can't just be interrupted by investment. This is a kind of...

01:16:17.086 --> 01:16:18.886
<v Tim Pritlove>This is social media companies.

01:16:19.506 --> 01:16:21.186
<v Meredith Whittaker>Social media and platform companies, right?

01:16:21.726 --> 01:16:23.486
<v Tim Pritlove>And isn't Telegram one of them?

01:16:23.986 --> 01:16:26.706
<v Meredith Whittaker>Well, Telegram doesn't, I think, run most of their own infrastructure.

01:16:26.706 --> 01:16:28.226
<v Meredith Whittaker>They don't have a cloud business model.

01:16:29.106 --> 01:16:34.186
<v Meredith Whittaker>And they also don't really have a business model. It seems like they have this crypto play.

01:16:34.466 --> 01:16:40.506
<v Meredith Whittaker>But it's not clear how that money moves. There's a lot of UAE investment.

01:16:40.686 --> 01:16:42.266
<v Meredith Whittaker>So you're not talking about these big tech...

01:16:42.266 --> 01:16:45.386
<v Tim Pritlove>Okay, you're focusing on cloud, not so much on the social media aspect.

01:16:45.386 --> 01:16:54.106
<v Meredith Whittaker>And what is it difficult? Where is the normative shape of the tech industry coming from, right?

01:16:54.206 --> 01:16:57.986
<v Meredith Whittaker>Like if the cloud companies all of a sudden decided to cut off half their APIs

01:16:57.986 --> 01:17:02.546
<v Meredith Whittaker>and change their infrastructure, there's like most startups in the entire world,

01:17:02.786 --> 01:17:07.426
<v Meredith Whittaker>including organizations like Signal, Telegram, whoever's writing on top,

01:17:08.406 --> 01:17:10.326
<v Meredith Whittaker>all their engineers' pagers go off.

01:17:10.686 --> 01:17:14.726
<v Meredith Whittaker>They got to respond to that, right? It's unidirectional that way.

01:17:14.846 --> 01:17:15.306
<v Linus Neumann>Right?

01:17:15.386 --> 01:17:23.546
<v Meredith Whittaker>If sanctions go up, let's do a wild dictator gets elected in the US and decides

01:17:23.546 --> 01:17:29.186
<v Meredith Whittaker>that Europe is now sanctioned and that Amazon can't do business with Europe. What happens?

01:17:29.906 --> 01:17:31.546
<v Tim Pritlove>Data in the US, that would never happen.

01:17:31.626 --> 01:17:34.706
<v Meredith Whittaker>I make things up as a creative person.

01:17:37.186 --> 01:17:39.566
<v Meredith Whittaker>Remember, I come from literature and rhetoric.

01:17:41.486 --> 01:17:43.246
<v Tim Pritlove>Just stories in your head. Ja.

01:17:43.886 --> 01:17:47.646
<v Meredith Whittaker>Und dann sieht man die Social Media Platforms, die wir wissen,

01:17:47.766 --> 01:17:50.786
<v Meredith Whittaker>dass es ein far-right ist,

01:17:50.986 --> 01:17:57.226
<v Meredith Whittaker>das wirklich hat die Intelligenz und Interessenzierung auf die Alternative Media

01:17:57.226 --> 01:18:04.226
<v Meredith Whittaker>Ecosystems über die Plattformen und die Affordanzer von Surveillance-Advertising-Driven

01:18:04.226 --> 01:18:07.166
<v Meredith Whittaker>Media Plattformen zu schaffen.

01:18:08.529 --> 01:18:12.169
<v Tim Pritlove>Okay, back to the magical thinking of Europe.

01:18:12.529 --> 01:18:14.969
<v Meredith Whittaker>Yeah. I'd like to understand how you see.

01:18:16.729 --> 01:18:19.169
<v Tim Pritlove>So in this world.

01:18:19.209 --> 01:18:23.189
<v Linus Neumann>There are like a few Europeans that say, here's 50 million, let's compete with these guys.

01:18:23.469 --> 01:18:23.589
<v Meredith Whittaker>Yeah, yeah, yeah.

01:18:23.589 --> 01:18:25.669
<v Tim Pritlove>And that's probably what the European search engine is.

01:18:25.729 --> 01:18:30.549
<v Meredith Whittaker>It's like 500 million dollars European sovereign AI fund.

01:18:30.749 --> 01:18:35.009
<v Meredith Whittaker>And then you're like, but that's half a training run. Like, what are you buying with that?

01:18:37.429 --> 01:18:41.149
<v Meredith Whittaker>Which is like which is disturbing because it's like okay well that's a lot of

01:18:41.149 --> 01:18:45.889
<v Meredith Whittaker>money also let's not be flip about it and it could be going to really good things

01:18:45.889 --> 01:18:49.889
<v Meredith Whittaker>it could be supporting you know interesting open projects it could be supporting

01:18:49.889 --> 01:18:55.849
<v Meredith Whittaker>you know alternative interoperable alternatives are like you know smaller clouds for more,

01:18:56.749 --> 01:19:03.649
<v Meredith Whittaker>heterodox open source project like there's really cool stuff that is languishing

01:19:03.649 --> 01:19:07.929
<v Meredith Whittaker>without that money and I think it's where is that money going?

01:19:08.069 --> 01:19:11.329
<v Meredith Whittaker>Well if you're talking about going into AI it's going to one of those three

01:19:11.329 --> 01:19:16.249
<v Meredith Whittaker>cloud companies it's renting infrastructure from Microsoft Amazon or Google

01:19:16.249 --> 01:19:21.509
<v Meredith Whittaker>for model development or for deployment which is inference and inference is

01:19:21.509 --> 01:19:23.509
<v Meredith Whittaker>really expensive you don't just train once,

01:19:24.069 --> 01:19:29.449
<v Meredith Whittaker>you use a model using it is way way more expensive than normal information retrieval

01:19:29.449 --> 01:19:33.349
<v Meredith Whittaker>and so you're also it's just this massive computationally expensive,

01:19:34.629 --> 01:19:41.329
<v Meredith Whittaker>Und du hast nicht die Europäische Sovereinheit, du hast eine Gefühl, die...

01:19:41.700 --> 01:19:46.920
<v Meredith Whittaker>I don't know, like, not behind, which, like, you know, and feeling of not being

01:19:46.920 --> 01:19:49.420
<v Meredith Whittaker>ashamed by being technologically...

01:19:49.420 --> 01:19:54.100
<v Tim Pritlove>But apart from the magical thinking, is there anything else you would stick to in Europe?

01:19:54.720 --> 01:19:58.320
<v Meredith Whittaker>And then there's the other side, which is I often find a much more sophisticated

01:19:58.320 --> 01:20:01.200
<v Meredith Whittaker>and clear-eyed view of these problems, right?

01:20:01.240 --> 01:20:04.880
<v Meredith Whittaker>Like, having this discussion about that concentrated power in the hands of infrastructure

01:20:04.880 --> 01:20:08.300
<v Meredith Whittaker>and media ecosystem, way easier in Europe.

01:20:08.520 --> 01:20:13.320
<v Meredith Whittaker>I mean, people feel it, right? They see it. And there's been a history of pushing

01:20:13.320 --> 01:20:15.880
<v Meredith Whittaker>back against the encroachment of US

01:20:15.880 --> 01:20:21.640
<v Meredith Whittaker>tech, both effectively and often very ineffectively, that I really enjoy.

01:20:21.800 --> 01:20:25.820
<v Meredith Whittaker>And particularly in Germany, there's a very high sensitivity to privacy,

01:20:26.080 --> 01:20:31.720
<v Meredith Whittaker>very often clear-eyed view on some of these debates, which doesn't always translate into policy.

01:20:31.720 --> 01:20:36.100
<v Meredith Whittaker>But there's at least, like I find the intellectual environment around this stuff,

01:20:36.280 --> 01:20:38.520
<v Meredith Whittaker>when you talk to people who are knowledgeable and have thought about it,

01:20:38.580 --> 01:20:43.080
<v Meredith Whittaker>to be very, I don't know, to teach me a lot and be really sophisticated.

01:20:43.080 --> 01:20:49.180
<v Tim Pritlove>Yeah, the GDPR is probably a German thing somehow in its core, for sure.

01:20:50.720 --> 01:20:56.560
<v Tim Pritlove>So how does this affect the talk to European politicians and how do you see

01:20:56.560 --> 01:21:05.160
<v Tim Pritlove>the trends in regulations and trying to apply new laws and regulations towards

01:21:05.160 --> 01:21:06.820
<v Tim Pritlove>this whole tech industry?

01:21:07.960 --> 01:21:14.760
<v Meredith Whittaker>Ja, ich meine, es gibt beide threads.

01:21:14.900 --> 01:21:19.200
<v Meredith Whittaker>Du hast zwei Wolves inside European Politik.

01:21:19.500 --> 01:21:23.140
<v Meredith Whittaker>Der eine will seine eigene Tech-Industrie und der eine will sie nicht zu machen.

01:21:23.980 --> 01:21:26.300
<v Meredith Whittaker>Das ist nicht zu US-Tech-Colonialismus.

01:21:27.320 --> 01:21:30.560
<v Meredith Whittaker>Und ich denke, du hast du some weirden Laws.

01:21:30.620 --> 01:21:35.660
<v Meredith Whittaker>Du hast die AI-Act, die aufwärtigte, die aufwärtigte, kind of had this last-minute

01:21:35.660 --> 01:21:39.620
<v Meredith Whittaker>brinksmanship around whether foundation models.

01:21:41.060 --> 01:21:46.340
<v Meredith Whittaker>These big LLMs that are now the trendy kind should be included or not.

01:21:46.540 --> 01:21:53.820
<v Meredith Whittaker>And you often see bold regulatory attempts that then get kind of shaped in odd

01:21:53.820 --> 01:21:56.640
<v Meredith Whittaker>ways, trying to have it both ways, right?

01:21:56.700 --> 01:22:00.440
<v Meredith Whittaker>Like how do we regulate the Americans away and get our own, right?

01:22:00.580 --> 01:22:03.980
<v Meredith Whittaker>But how do we do that in a way that it is reflected in principles,

01:22:04.080 --> 01:22:06.980
<v Meredith Whittaker>not in actually declaring that as an intent.

01:22:07.820 --> 01:22:12.780
<v Meredith Whittaker>And I think that is, I think you're seeing a huge amount of money be spent by

01:22:12.780 --> 01:22:18.340
<v Meredith Whittaker>the US companies in Brussels right now, which is also influencing things in interesting ways.

01:22:18.700 --> 01:22:23.020
<v Meredith Whittaker>And then this is something I'm theorizing a lot in my intellectual work,

01:22:23.700 --> 01:22:26.860
<v Meredith Whittaker>or just, and I think is really important.

01:22:27.400 --> 01:22:31.220
<v Meredith Whittaker>You also see what I'm calling the politics of intellectual shame.

01:22:31.620 --> 01:22:36.120
<v Meredith Whittaker>Be really pervasive in this conversation and this is not just Europe this is across the board.

01:22:37.200 --> 01:22:38.860
<v Meredith Whittaker>I mean that there is a real.

01:22:40.469 --> 01:22:44.429
<v Meredith Whittaker>A real fear among a lot of people who are in decision-making positions,

01:22:44.709 --> 01:22:47.349
<v Meredith Whittaker>politicians or academics or whoever,

01:22:47.809 --> 01:22:52.709
<v Meredith Whittaker>and not even in decision-making positions, but it matters when it's them,

01:22:52.909 --> 01:22:56.009
<v Meredith Whittaker>of being stupid about tech,

01:22:56.509 --> 01:22:58.609
<v Meredith Whittaker>of being behind the ball on tech.

01:22:59.309 --> 01:23:02.289
<v Meredith Whittaker>And this plays right into patriarchal dynamics.

01:23:02.469 --> 01:23:07.849
<v Meredith Whittaker>Men hate when someone else knows something more than them, in particular if that's a small woman.

01:23:08.009 --> 01:23:09.469
<v Linus Neumann>I think we enjoy it right now.

01:23:09.469 --> 01:23:10.709
<v Meredith Whittaker>Ja, ja, ja. Totally.

01:23:11.009 --> 01:23:11.769
<v Linus Neumann>Wir haben eine gute Zeit.

01:23:12.069 --> 01:23:19.889
<v Meredith Whittaker>Ja. Well, you all are, generally, and I don't want to gender this in such a

01:23:19.889 --> 01:23:24.909
<v Meredith Whittaker>schematic, but there is an ego that can be very, very fragile here.

01:23:25.069 --> 01:23:29.449
<v Meredith Whittaker>And the way I've put it before is it kind of turns uncertain men into yes men.

01:23:29.769 --> 01:23:32.569
<v Meredith Whittaker>Like, they don't want to ask the dumb question. They don't want to be like,

01:23:32.569 --> 01:23:35.649
<v Meredith Whittaker>what's an LLM? What's a server? Like, how does that work?

01:23:35.929 --> 01:23:40.869
<v Meredith Whittaker>And that type of insecurity, The fear of being behind, the fear of being called

01:23:40.869 --> 01:23:46.089
<v Meredith Whittaker>technically unsophisticated or hampering progress or putting your finger on

01:23:46.089 --> 01:23:50.369
<v Meredith Whittaker>the scales of science, look the Nobels, how could you stand in the way of all this progress?

01:23:50.369 --> 01:23:57.129
<v Meredith Whittaker>I think really gives the upper hand to the companies and those who have an interest

01:23:57.129 --> 01:24:04.389
<v Meredith Whittaker>in creating products and growth and domination via these technologies.

01:24:04.949 --> 01:24:09.249
<v Meredith Whittaker>Because people really don't want to challenge them because challenging their

01:24:09.249 --> 01:24:14.689
<v Meredith Whittaker>dominance or their plans gets conflated with somehow being anti-science or being

01:24:14.689 --> 01:24:19.009
<v Meredith Whittaker>stupid about tech or not being smart enough to have a position on a topic.

01:24:19.009 --> 01:24:22.269
<v Meredith Whittaker>And I think that's something because I kind of came up through Google asking

01:24:22.269 --> 01:24:26.169
<v Meredith Whittaker>every dumb question in the book because I had no I didn't come from that world.

01:24:26.309 --> 01:24:29.649
<v Meredith Whittaker>Right. So I had to ask, like, how does a computer work? Right.

01:24:29.809 --> 01:24:34.389
<v Meredith Whittaker>I'm like, I'm like, can someone diagram what a function is? I don't know any of this stuff. Right.

01:24:35.329 --> 01:24:40.409
<v Meredith Whittaker>But I kind of I think I have a sensitivity to that because I also I remember feeling it.

01:24:40.489 --> 01:24:43.049
<v Meredith Whittaker>I remember people being mean about it. Like if I didn't, you know,

01:24:43.129 --> 01:24:46.089
<v Meredith Whittaker>like back in the day when I was trying to learn this stuff.

01:24:46.369 --> 01:24:52.649
<v Meredith Whittaker>And I think that, you know, a discourse that collapses scientific progress into kind of.

01:24:54.411 --> 01:25:00.551
<v Meredith Whittaker>The success of a handful of tech companies preys on that type of insecurity

01:25:00.551 --> 01:25:04.991
<v Meredith Whittaker>and has created an environment in which people have no idea what AI is and are

01:25:04.991 --> 01:25:08.231
<v Meredith Whittaker>still professing boldly on how to regulate it.

01:25:10.711 --> 01:25:17.911
<v Tim Pritlove>So I read it as you think that the European positions might be slightly under-informed

01:25:17.911 --> 01:25:22.131
<v Tim Pritlove>and probably not well thought out in the current situation.

01:25:22.131 --> 01:25:26.291
<v Meredith Whittaker>I should be clear. I don't think that what I was describing and the politics

01:25:26.291 --> 01:25:32.311
<v Meredith Whittaker>of intellectual shame are not unique to Europe, but I think are in Europe as well.

01:25:32.691 --> 01:25:37.011
<v Meredith Whittaker>And particularly folks who feel like, you know, the Americans beat us, we got to get ahead.

01:25:37.191 --> 01:25:44.171
<v Meredith Whittaker>Right. I think where I see the European position being most, let's say,

01:25:44.311 --> 01:25:50.051
<v Meredith Whittaker>under-informed or perhaps just in some cases pernicious is in the chat controls

01:25:50.051 --> 01:25:53.491
<v Meredith Whittaker>regulation and the desire,

01:25:53.971 --> 01:25:59.711
<v Meredith Whittaker>the apex of magical thinking, Which is, you know, let's rename a backdoor client-side

01:25:59.711 --> 01:26:04.311
<v Meredith Whittaker>scanning and then let's mandate scanning everyone's private messages,

01:26:04.651 --> 01:26:08.311
<v Meredith Whittaker>comparing what's in those messages against some database of permissible or impermissible

01:26:08.311 --> 01:26:12.851
<v Meredith Whittaker>content and then, you know, taking action on those, you know,

01:26:12.951 --> 01:26:14.651
<v Meredith Whittaker>in the name of protecting children,

01:26:14.911 --> 01:26:20.611
<v Meredith Whittaker>which is the justification during this instantiation of the crypto wars.

01:26:20.611 --> 01:26:25.891
<v Tim Pritlove>Let's stick to this topic, because it's still an ongoing battle right now.

01:26:26.091 --> 01:26:29.991
<v Tim Pritlove>We are more or less talking about this in every of our shows.

01:26:30.411 --> 01:26:35.091
<v Tim Pritlove>And yeah, it's still totally unclear what's going to come out of this.

01:26:35.271 --> 01:26:37.851
<v Tim Pritlove>How do you see this discussion evolve?

01:26:38.731 --> 01:26:43.851
<v Meredith Whittaker>Well, I don't, you know, I see this as an ongoing power struggle, right?

01:26:44.891 --> 01:26:51.051
<v Meredith Whittaker>Between who? Well, between, like this is not a misunderstanding.

01:26:51.751 --> 01:26:56.191
<v Meredith Whittaker>I think a lot of the people pushing for this understand that backdoors are dangerous

01:26:56.191 --> 01:27:01.431
<v Meredith Whittaker>and understand that, you know, the pretext is flimsy, but that, you know.

01:27:03.011 --> 01:27:08.511
<v Meredith Whittaker>Asymmetric power constitutes itself in part through information asymmetry.

01:27:09.561 --> 01:27:14.021
<v Meredith Whittaker>And there's a deep discomfort that dates back to 1976 when Diffie Hellman were

01:27:14.021 --> 01:27:18.841
<v Meredith Whittaker>trying to publish their paper introducing public cryptography and the U.S.

01:27:18.901 --> 01:27:21.961
<v Meredith Whittaker>Government was trying to suppress it, trying to say, don't publish this, right?

01:27:22.201 --> 01:27:25.141
<v Meredith Whittaker>And then, you know, but databases weren't quite big enough, networks weren't

01:27:25.141 --> 01:27:28.121
<v Meredith Whittaker>quite big enough or ubiquitous enough for it to matter, matter.

01:27:28.301 --> 01:27:32.341
<v Meredith Whittaker>But they were already looking at like, oh, shit, we don't want this in the public,

01:27:32.541 --> 01:27:36.661
<v Meredith Whittaker>right? And then you go through the 90s and there's the Clipper chip and key

01:27:36.661 --> 01:27:41.601
<v Meredith Whittaker>escrow and you have Stuart Baker writing in Wired magazine, like PGP is just

01:27:41.601 --> 01:27:42.841
<v Meredith Whittaker>for terrorists. We have proof.

01:27:43.201 --> 01:27:47.141
<v Meredith Whittaker>No, PGP is for pedophiles, right? Which really echoes what we're hearing now.

01:27:47.541 --> 01:27:52.021
<v Meredith Whittaker>Right? Like who even has a computer in 1994, I believe, when this op-ed is written?

01:27:52.241 --> 01:27:56.641
<v Meredith Whittaker>And then we have Post 9-11 and then it's like, actually, PGP is for terrorists, right?

01:27:56.681 --> 01:28:01.061
<v Meredith Whittaker>And encryption is for terrorists. All the while, our dependency on digital infrastructures

01:28:01.061 --> 01:28:03.721
<v Meredith Whittaker>for communications is growing and growing and growing.

01:28:03.901 --> 01:28:06.401
<v Meredith Whittaker>Our dependency on digital infrastructures generally is growing.

01:28:06.601 --> 01:28:12.361
<v Meredith Whittaker>And the need for encryption to protect commerce becomes existential to the Internet industry.

01:28:12.641 --> 01:28:18.201
<v Meredith Whittaker>And then what do you do about communications, right? And I think this has been

01:28:18.201 --> 01:28:22.381
<v Meredith Whittaker>an anxiety that is pervasive among those who, you know, law enforcement,

01:28:22.621 --> 01:28:26.841
<v Meredith Whittaker>governments, whoever, who feel that they need to constitute their power via

01:28:26.841 --> 01:28:28.141
<v Meredith Whittaker>information asymmetry.

01:28:28.341 --> 01:28:33.721
<v Meredith Whittaker>And any encryption that protects people, not just commerce, is a threat to that, right?

01:28:33.861 --> 01:28:36.561
<v Meredith Whittaker>And so what I don't see is that we're going to win an argument,

01:28:36.841 --> 01:28:40.021
<v Meredith Whittaker>right, or that we're going to win this via strength of argument.

01:28:40.021 --> 01:28:43.941
<v Meredith Whittaker>I do think we can fight and we, you know, I think, I think we're in a position

01:28:43.941 --> 01:28:47.901
<v Meredith Whittaker>now where we're seeing, we're seeing chat controls, you know,

01:28:47.961 --> 01:28:50.821
<v Meredith Whittaker>I believe Hungary just tried to raise it and didn't get the support.

01:28:51.041 --> 01:28:56.381
<v Meredith Whittaker>There was the Belgian proposal a few months ago, also didn't get the support at the last minute.

01:28:57.041 --> 01:29:01.621
<v Meredith Whittaker>And we just had the Dutch law enforcement authorities writing a memo to the

01:29:01.621 --> 01:29:04.581
<v Meredith Whittaker>government there saying, yo, don't support this.

01:29:04.821 --> 01:29:08.721
<v Meredith Whittaker>You're talking about a very dangerous backdoor that would undermine Dutch cybersecurity,

01:29:09.081 --> 01:29:12.881
<v Meredith Whittaker>right? At the same time, we have reporting in the Wall Street Journal...

01:29:13.913 --> 01:29:17.333
<v Meredith Whittaker>Es gibt einen Receit für was, was all of us should have suspected all along,

01:29:17.573 --> 01:29:22.473
<v Meredith Whittaker>ist, dass die Backdoors, die in den US-Telecommunications Infrastruktur,

01:29:22.673 --> 01:29:28.433
<v Meredith Whittaker>für Government Intercept, haben wir von China-Intelligence und vielleicht anderen.

01:29:29.613 --> 01:29:32.393
<v Meredith Whittaker>Ich denke, an dieser Moment, wir haben ein vieles...

01:29:34.713 --> 01:29:39.013
<v Meredith Whittaker>Die Facts sind auf unserer Seite, und die Facts sind auf der Seite,

01:29:39.053 --> 01:29:43.353
<v Meredith Whittaker>ist permeatet in diese Diskussion, and making it harder and harder for them

01:29:43.353 --> 01:29:45.953
<v Meredith Whittaker>to push it forward in the European Commission.

01:29:46.113 --> 01:29:49.673
<v Linus Neumann>But that usually means they just do another attempt next year.

01:29:49.813 --> 01:29:53.233
<v Meredith Whittaker>Exactly. And that's why I think we're not going to win. There's going to be

01:29:53.233 --> 01:29:56.213
<v Meredith Whittaker>another pretext if we win this one, right?

01:29:56.293 --> 01:29:59.053
<v Meredith Whittaker>There's going to be another angle if we win this one.

01:29:59.193 --> 01:30:02.913
<v Meredith Whittaker>We just have to keep building our muscle to sustain this fight probably forever,

01:30:03.413 --> 01:30:06.213
<v Meredith Whittaker>because I don't think the will to power is going away.

01:30:06.673 --> 01:30:10.573
<v Meredith Whittaker>I think they're just going to keep trying to rearrange the reasoning.

01:30:10.573 --> 01:30:14.993
<v Tim Pritlove>Aber wie geht es? Wenn Sie sagen, dass die Strecke der Argument nicht genug ist, ist es nicht genug?

01:30:15.133 --> 01:30:16.033
<v Meredith Whittaker>Ich mache Yoga every day.

01:30:16.433 --> 01:30:17.233
<v Tim Pritlove>Does es helfen?

01:30:17.513 --> 01:30:18.673
<v Meredith Whittaker>Ich meine, yes, es hilft.

01:30:18.893 --> 01:30:21.253
<v Tim Pritlove>Ich meine, in terms of politische Diskussionen.

01:30:24.013 --> 01:30:28.093
<v Meredith Whittaker>In terms of politische Diskussionen, es hilft, dass wir richtig sind.

01:30:29.327 --> 01:30:33.187
<v Meredith Whittaker>We bring in, there's a huge amount of evidence that a lot of people haven't

01:30:33.187 --> 01:30:35.707
<v Meredith Whittaker>seen in these political discussions.

01:30:36.107 --> 01:30:40.787
<v Meredith Whittaker>I think we're on the, our side has been on the back foot for a while.

01:30:41.467 --> 01:30:46.947
<v Meredith Whittaker>There has been just in civil society, there's been cutting funding to privacy

01:30:46.947 --> 01:30:53.467
<v Meredith Whittaker>advocacy has happened since around, there's a sort of a history here.

01:30:53.467 --> 01:30:59.227
<v Meredith Whittaker>I think there's a move toward tech accountability happened after the 2016 election.

01:30:59.667 --> 01:31:02.067
<v Meredith Whittaker>There's the Cambridge Analytica scandal. There's all of this.

01:31:02.167 --> 01:31:04.627
<v Meredith Whittaker>And it's like, okay, we need to hold tech accountable.

01:31:05.207 --> 01:31:10.507
<v Meredith Whittaker>And then there are a number of – the way to hold tech accountable is to attack

01:31:10.507 --> 01:31:12.547
<v Meredith Whittaker>the business model, is my view.

01:31:12.947 --> 01:31:17.107
<v Meredith Whittaker>But there aren't that many pieces of legislation or proposals that actually do that.

01:31:17.547 --> 01:31:22.187
<v Meredith Whittaker>Many of them sort of use the wrapping and the language of accountability.

01:31:22.967 --> 01:31:26.087
<v Meredith Whittaker>But are actually just expanding surveillance, right?

01:31:26.187 --> 01:31:28.587
<v Meredith Whittaker>It's like, we're going to hold them accountable, so we need a database,

01:31:28.787 --> 01:31:34.167
<v Meredith Whittaker>so we need to know who's logging into websites so we can find the bad guy.

01:31:34.207 --> 01:31:40.767
<v Meredith Whittaker>We need to know what's in your messaging so that we can make sure that these

01:31:40.767 --> 01:31:43.727
<v Meredith Whittaker>tech companies aren't allowing crime on their platforms, et cetera, et cetera.

01:31:43.827 --> 01:31:48.967
<v Meredith Whittaker>So it was basically a hijacking of this, in many cases, kind of righteous moment

01:31:48.967 --> 01:31:51.667
<v Meredith Whittaker>where people recognize that this business model was pretty harmful,

01:31:51.927 --> 01:31:56.627
<v Meredith Whittaker>to fulfill the wishes that have been pervasive since well before then.

01:31:56.987 --> 01:32:00.567
<v Meredith Whittaker>At the same time that we're seeing privacy advocacy and a lot of those,

01:32:00.747 --> 01:32:04.107
<v Meredith Whittaker>you know, a lot of the things Linus, you and I had been doing for a long time,

01:32:04.267 --> 01:32:07.807
<v Meredith Whittaker>receiving less and less support and sort of, you know, out of the limelight.

01:32:08.087 --> 01:32:13.167
<v Meredith Whittaker>And so I think it was in that environment that things like chat controls,

01:32:13.327 --> 01:32:16.987
<v Meredith Whittaker>that things like the online safety bill and other, you know,

01:32:17.247 --> 01:32:23.667
<v Meredith Whittaker>paradigmatic examples of this, you client-side scanning to save children meme,

01:32:24.287 --> 01:32:27.427
<v Meredith Whittaker>grew up and then one of the reasons I was,

01:32:28.469 --> 01:32:29.829
<v Meredith Whittaker>There are many, many reasons I

01:32:29.829 --> 01:32:33.809
<v Meredith Whittaker>decided to move from being on the board of Signal to full-time at Signal.

01:32:34.249 --> 01:32:41.849
<v Meredith Whittaker>One of them was that I saw this moment and I realized there weren't that many

01:32:41.849 --> 01:32:48.489
<v Meredith Whittaker>people fighting it and that one of the things that I could bring was a staunch

01:32:48.489 --> 01:32:49.669
<v Meredith Whittaker>willingness to fight it.

01:32:50.429 --> 01:32:55.749
<v Tim Pritlove>And how do you do that? I mean, can you walk us through a day?

01:32:55.989 --> 01:33:02.309
<v Meredith Whittaker>I open up my laptop. Ja, um, um, well, we, you know, it's not,

01:33:02.449 --> 01:33:06.289
<v Meredith Whittaker>obviously, it's not just me, nothing like this is a singular thing.

01:33:06.429 --> 01:33:09.669
<v Meredith Whittaker>We work with a pretty broad coalition of folks. I'm sure, you know,

01:33:09.769 --> 01:33:13.189
<v Meredith Whittaker>many of your friends, many listeners, perhaps, are part of that.

01:33:13.589 --> 01:33:17.949
<v Meredith Whittaker>Um, Signal doesn't have a policy arm. It's a very kind of lean,

01:33:18.489 --> 01:33:20.629
<v Meredith Whittaker>targeted, pretty senior organization.

01:33:21.289 --> 01:33:26.029
<v Meredith Whittaker>But we do work with people around the globe EDRI and the EU a number of other

01:33:26.029 --> 01:33:31.609
<v Meredith Whittaker>organizations to keep tabs on what's happening we also are in a good position.

01:33:33.509 --> 01:33:42.069
<v Meredith Whittaker>We're a non-profit we are very committed to rigorous communication so we don't

01:33:42.069 --> 01:33:47.189
<v Meredith Whittaker>have a history of hyper-marketing we don't do hyper-marketing now and so we're

01:33:47.189 --> 01:33:50.749
<v Meredith Whittaker>very careful when we make a claim When we make a statement,

01:33:51.249 --> 01:33:53.369
<v Meredith Whittaker>we're backing that with citations. It's accurate.

01:33:53.629 --> 01:33:57.709
<v Meredith Whittaker>We're really marshalling the technical knowledge and prowess that we have.

01:33:58.869 --> 01:34:04.649
<v Meredith Whittaker>I almost think of it as clarifying the record. If there's a report that says

01:34:04.649 --> 01:34:07.889
<v Meredith Whittaker>client-side scanning is actually safe, we know it's not safe.

01:34:08.049 --> 01:34:10.809
<v Meredith Whittaker>Okay, well, there's an academic coalition that has written this letter.

01:34:11.029 --> 01:34:15.569
<v Meredith Whittaker>Signal can write a letter. We can begin to put a bit more weight on the scales

01:34:15.569 --> 01:34:22.189
<v Meredith Whittaker>that have been fairly light, given the dynamics I just outlined.

01:34:22.389 --> 01:34:25.289
<v Meredith Whittaker>And then I do media, I do public speaking.

01:34:25.569 --> 01:34:33.149
<v Meredith Whittaker>I think a lot about how to tell this story in a way that isn't boring or alienating

01:34:33.149 --> 01:34:37.729
<v Meredith Whittaker>for regular people, particularly because the story on the other side is so arresting.

01:34:37.969 --> 01:34:41.029
<v Meredith Whittaker>It's like we have to save children from abuse.

01:34:41.549 --> 01:34:45.189
<v Meredith Whittaker>And that every one of us it like hits you in the heart, right?

01:34:45.309 --> 01:34:49.109
<v Meredith Whittaker>Like myself, right? Like my amygdala is activated.

01:34:49.429 --> 01:34:53.129
<v Meredith Whittaker>I, you know, suddenly I just want to do something. I want to help,

01:34:53.269 --> 01:34:55.749
<v Meredith Whittaker>you know, give me the thing to do. How do we do that, right?

01:34:56.249 --> 01:35:00.849
<v Meredith Whittaker>And then sitting across from that and being like, well, let me tell you about

01:35:00.849 --> 01:35:03.389
<v Meredith Whittaker>a one-way function, right? Like you can't, that's not.

01:35:05.429 --> 01:35:09.049
<v Meredith Whittaker>That's not going to work, right? And so like, how do you,

01:35:10.780 --> 01:35:15.480
<v Meredith Whittaker>How do you enter into that debate in a way that isn't dismissing the very grim

01:35:15.480 --> 01:35:21.080
<v Meredith Whittaker>and real problem that is being evoked and make it clear that the solution to

01:35:21.080 --> 01:35:24.800
<v Meredith Whittaker>that problem that is being presented will not solve that problem, one,

01:35:24.960 --> 01:35:30.740
<v Meredith Whittaker>and two, will cause drastically worse problems for many people around the world?

01:35:30.900 --> 01:35:32.860
<v Meredith Whittaker>And that's the task at hand right now.

01:35:32.860 --> 01:35:35.560
<v Tim Pritlove>So basically the discussion is

01:35:35.560 --> 01:35:41.360
<v Tim Pritlove>led by pointing the other side to like the infeasibility of the approach.

01:35:41.360 --> 01:35:45.380
<v Meredith Whittaker>Well, the infeasibility, the danger of the approach,

01:35:45.780 --> 01:35:50.500
<v Meredith Whittaker>a lot of evidence around the infeasibility of the approach that is either kind

01:35:50.500 --> 01:35:53.120
<v Meredith Whittaker>of willfully ignored or just not understood,

01:35:53.500 --> 01:36:02.000
<v Meredith Whittaker>and then figuring out how we explain that without being either accidentally

01:36:02.000 --> 01:36:05.620
<v Meredith Whittaker>or genuinely callous about the concerns that have brought people to the table.

01:36:05.820 --> 01:36:08.520
<v Tim Pritlove>Then they will say, but we have to do something.

01:36:08.520 --> 01:36:11.800
<v Meredith Whittaker>Well, how about funding social services?

01:36:12.640 --> 01:36:17.540
<v Meredith Whittaker>How about, you know, what do you do? And I mean, like, if we're going to go

01:36:17.540 --> 01:36:18.380
<v Meredith Whittaker>there, we're going to go there.

01:36:19.638 --> 01:36:20.758
<v Meredith Whittaker>Prince Andrew's walking around.

01:36:20.758 --> 01:36:23.158
<v Tim Pritlove>No, you're suggesting to make the world better.

01:36:23.258 --> 01:36:27.478
<v Meredith Whittaker>Jimmy Savile's walking around. You know, like what are the infrastructures in

01:36:27.478 --> 01:36:29.798
<v Meredith Whittaker>place to make sure that when children are going through this,

01:36:29.918 --> 01:36:31.898
<v Meredith Whittaker>they're believed, they're protected.

01:36:32.138 --> 01:36:35.238
<v Meredith Whittaker>You know, what happens when it's your priest? What happens when it's your teacher?

01:36:35.398 --> 01:36:38.858
<v Meredith Whittaker>What happens when it's your brother, right? Like these are the questions that

01:36:38.858 --> 01:36:43.098
<v Meredith Whittaker>are really hard to look in the face because they implicate social pathologies

01:36:43.098 --> 01:36:47.558
<v Meredith Whittaker>and interpersonal relationships and power dynamics that are really,

01:36:47.738 --> 01:36:54.518
<v Meredith Whittaker>really difficult and often relate to emotionally challenging factors outside

01:36:54.518 --> 01:36:57.298
<v Meredith Whittaker>of that or people's past experiences or what have you.

01:36:57.338 --> 01:37:01.218
<v Meredith Whittaker>So you're going right into very traumatic subjects.

01:37:02.398 --> 01:37:06.678
<v Meredith Whittaker>But I don't think we can have that conversation without having a real conversation.

01:37:06.978 --> 01:37:10.458
<v Meredith Whittaker>And then when you begin to pull back the layers there, you say,

01:37:10.538 --> 01:37:17.718
<v Meredith Whittaker>oh, well, the UK has been pushing for client-side scanning as a remediation to child abuse.

01:37:18.438 --> 01:37:27.138
<v Meredith Whittaker>But the UK government in 2023 funded social services at 7% of the amount recommended.

01:37:28.318 --> 01:37:32.298
<v Meredith Whittaker>Right? So like there's, you know, the roofs on the schools in the UKs are collapsing.

01:37:32.618 --> 01:37:35.618
<v Meredith Whittaker>Like, you know, there isn't support for this.

01:37:35.878 --> 01:37:39.778
<v Meredith Whittaker>And then if you, you know, if you look at, and I don't have public numbers to

01:37:39.778 --> 01:37:42.078
<v Meredith Whittaker>share, but I've had a number of personal conversations.

01:37:42.078 --> 01:37:47.398
<v Meredith Whittaker>Okay, well, how many law enforcement people, how many people are tasked with

01:37:47.398 --> 01:37:49.998
<v Meredith Whittaker>actually sort of pursuing the,

01:37:49.998 --> 01:37:54.278
<v Meredith Whittaker>you know, like the criminality that may be reported via online imagery?

01:37:55.158 --> 01:38:01.998
<v Meredith Whittaker>In some cases, it's two. In one case, it's two in one country. Two people, right?

01:38:02.358 --> 01:38:05.218
<v Meredith Whittaker>So, like, you're not actually, like, if you begin to map this,

01:38:05.418 --> 01:38:08.038
<v Meredith Whittaker>what you see is a story that does not add up.

01:38:08.158 --> 01:38:11.778
<v Meredith Whittaker>And you see, like, what, you know, and this is where I get enraged.

01:38:12.078 --> 01:38:14.638
<v Meredith Whittaker>Because I'm like, you are fucking trading...

01:38:15.721 --> 01:38:20.101
<v Meredith Whittaker>On children's pain, to get your backdoor, whatever the fuck you want,

01:38:21.181 --> 01:38:24.961
<v Meredith Whittaker>pretending that you're solving it, so taking up the space for actual solutions

01:38:24.961 --> 01:38:28.481
<v Meredith Whittaker>that could actually help real children who are suffering now,

01:38:29.081 --> 01:38:35.021
<v Meredith Whittaker>and turning no attention to every glaring problem in this massive list,

01:38:35.681 --> 01:38:41.101
<v Meredith Whittaker>which is pretty obvious, even for me, and I'm not an expert here,

01:38:41.101 --> 01:38:42.901
<v Meredith Whittaker>I've just sort of sifted through this.

01:38:42.981 --> 01:38:46.361
<v Meredith Whittaker>So I think that's the dynamic we're walking into.

01:38:47.461 --> 01:38:51.481
<v Tim Pritlove>They might only have two people, but at some point in time they might have doubled,

01:38:54.021 --> 01:38:55.561
<v Tim Pritlove>by adding another one.

01:38:55.681 --> 01:39:01.501
<v Linus Neumann>I agree that, I mean, it is quite telling how much emphasis is being laid on,

01:39:01.601 --> 01:39:05.261
<v Linus Neumann>hey, we really need client-side scanning and then the world is going to be safe.

01:39:06.061 --> 01:39:10.561
<v Linus Neumann>And, you know, if you say, well, how about we, you know, we fund support or

01:39:10.561 --> 01:39:16.681
<v Linus Neumann>any kind of prevention, preventive activities in um social care it's like yeah.

01:39:16.681 --> 01:39:21.821
<v Meredith Whittaker>Yeah yeah well sorry we use the prefix online so that's not our,

01:39:23.241 --> 01:39:30.321
<v Meredith Whittaker>um and i think it's also like there's something people gravitate to the abstraction

01:39:30.321 --> 01:39:34.881
<v Meredith Whittaker>right if this is online child abuse then we don't have to deal with it in our

01:39:34.881 --> 01:39:38.941
<v Meredith Whittaker>real lives it becomes an abstraction that we can almost blame on the same platforms

01:39:38.941 --> 01:39:42.941
<v Meredith Whittaker>that have been so unaccountable we can blame it as an internet phenomenon, not a phenomenon.

01:39:43.221 --> 01:39:46.621
<v Meredith Whittaker>And like, oh wait, our church doesn't have the infrastructure to actually deal

01:39:46.621 --> 01:39:50.541
<v Meredith Whittaker>with this in a humane way, right? And I think that's a dynamic that we're also seeing here.

01:39:50.861 --> 01:39:57.061
<v Linus Neumann>This is, by the way, one thing I find so interesting about Signal as a secure messenger.

01:39:58.261 --> 01:40:05.821
<v Linus Neumann>Well, it has become mainstream, but it has also managed to maintain a reputation

01:40:05.821 --> 01:40:12.081
<v Linus Neumann>of goodness, right? I mean, saying like, okay, text me on signals.

01:40:12.181 --> 01:40:15.681
<v Linus Neumann>Oh yeah, that's the secure messenger, blue symbol, looks nice,

01:40:15.901 --> 01:40:17.521
<v Linus Neumann>you know, very friendly user interface.

01:40:18.661 --> 01:40:25.101
<v Linus Neumann>Or it would be like, let's text on 3MAR, be like, oh, that's the complicated black one.

01:40:26.061 --> 01:40:31.001
<v Linus Neumann>Well, how about Telegram? And that's like, okay, that's a completely different end of the internet.

01:40:32.461 --> 01:40:40.381
<v Linus Neumann>And that makes me think of the curious case of Pavel Durov being detained in

01:40:40.381 --> 01:40:51.041
<v Linus Neumann>France and apparently at least charged because they refused to cooperate in numerous cases.

01:40:53.321 --> 01:40:56.881
<v Linus Neumann>Why do you dare to come to Europe, Meredith?

01:40:57.421 --> 01:41:03.821
<v Meredith Whittaker>Well, I'm a brave person, Linus. Aber, zu sagen, ich denke,

01:41:04.949 --> 01:41:10.169
<v Meredith Whittaker>This is one of the places where more public education is necessary because Telegram

01:41:10.169 --> 01:41:14.269
<v Meredith Whittaker>is actually, you said the other end of the internet, it is very,

01:41:14.269 --> 01:41:15.989
<v Meredith Whittaker>very, very different from Signal.

01:41:16.409 --> 01:41:21.369
<v Meredith Whittaker>So Telegram is a social media platform. It allows mass broadcasts to millions

01:41:21.369 --> 01:41:23.389
<v Meredith Whittaker>of people. You can go viral on Telegram.

01:41:23.529 --> 01:41:26.229
<v Meredith Whittaker>You can find strangers on Telegram via directories.

01:41:26.389 --> 01:41:32.729
<v Meredith Whittaker>There's a near-me feature that will geolocate things happening near you,

01:41:32.729 --> 01:41:36.849
<v Meredith Whittaker>all sorts of things that are not private, are not secure,

01:41:37.369 --> 01:41:42.329
<v Meredith Whittaker>are regulated completely differently from private and secure communications

01:41:42.329 --> 01:41:48.149
<v Meredith Whittaker>like Signal, which is solely a private and secure interpersonal communications app.

01:41:48.309 --> 01:41:49.869
<v Linus Neumann>What about Signal Stories, though?

01:41:50.349 --> 01:41:56.529
<v Meredith Whittaker>Signal Stories don't go viral. If I sent all the people in my contact list one

01:41:56.529 --> 01:41:58.729
<v Meredith Whittaker>by one a photo or something...

01:41:59.289 --> 01:42:00.589
<v Linus Neumann>I don't get your stories.

01:42:00.829 --> 01:42:04.149
<v Meredith Whittaker>They're so cute, Linus. I wish, like, it's, you know.

01:42:04.349 --> 01:42:04.569
<v Tim Pritlove>I hate it.

01:42:04.589 --> 01:42:07.429
<v Linus Neumann>I mean, that feature was implemented. I was like, okay, where can I turn it off?

01:42:07.569 --> 01:42:10.549
<v Meredith Whittaker>I'm sorry. Well, you're all missing my stories is all I'm saying,

01:42:10.589 --> 01:42:11.489
<v Meredith Whittaker>and they are pretty good.

01:42:12.489 --> 01:42:14.009
<v Tim Pritlove>Have you sent us some? No.

01:42:14.529 --> 01:42:21.169
<v Meredith Whittaker>Well, have you activated them to check? But we do let you deactivate them forever

01:42:21.169 --> 01:42:24.769
<v Meredith Whittaker>and never bother you about them, which is, you know, part of the way that I

01:42:24.769 --> 01:42:29.309
<v Meredith Whittaker>think we maintain our reputation for not being shitty is we try to literally not be shitty.

01:42:29.369 --> 01:42:29.749
<v Tim Pritlove>Yeah, thanks.

01:42:29.849 --> 01:42:35.109
<v Meredith Whittaker>Right? And when we're designing Signal, we're actually very,

01:42:35.209 --> 01:42:37.349
<v Meredith Whittaker>very careful not to be a social media platform.

01:42:37.569 --> 01:42:43.829
<v Meredith Whittaker>We think about that in the design phase so everything we do can be as encrypted as possible.

01:42:43.969 --> 01:42:49.129
<v Meredith Whittaker>So that we don't know anything about you or as close to zero about the people

01:42:49.129 --> 01:42:50.409
<v Meredith Whittaker>who use Signal as possible.

01:42:50.529 --> 01:42:55.609
<v Meredith Whittaker>And what we do know is we can say, yes, this phone number did sign up for a

01:42:55.609 --> 01:42:58.829
<v Meredith Whittaker>Signal account. We know when that phone number signed up for a signal count

01:42:58.829 --> 01:43:01.689
<v Meredith Whittaker>and we know last time they accessed it.

01:43:02.702 --> 01:43:07.982
<v Meredith Whittaker>Um, but we don't, you know, we, we would like to even not know that if it were possible.

01:43:08.262 --> 01:43:13.802
<v Meredith Whittaker>On the other hand, Telegram is a social media platform, which retains huge amounts of data,

01:43:14.122 --> 01:43:20.022
<v Meredith Whittaker>has a duty to under law to cooperate in turning over that data and was search

01:43:20.022 --> 01:43:25.462
<v Meredith Whittaker>functions that has search functions, has, you know, directories so you can find new things.

01:43:25.582 --> 01:43:32.022
<v Meredith Whittaker>So it's a, it's a very different beast. And I think, one, because Durov has, you know, been very.

01:43:33.402 --> 01:43:39.522
<v Meredith Whittaker>I'm trying for a diplomatic word, like, has made statements that are not supported

01:43:39.522 --> 01:43:44.322
<v Meredith Whittaker>by fact around Telegram being private and secure and kind of taken on this,

01:43:44.462 --> 01:43:47.902
<v Meredith Whittaker>you know, like yeoman's defender of free speech and privacy position.

01:43:48.282 --> 01:43:53.702
<v Meredith Whittaker>People often think Telegram is private and secure because it has a DMs feature, right?

01:43:53.842 --> 01:43:59.002
<v Meredith Whittaker>But, you know, Signal is just private and secure. So the TLDR on that is,

01:43:59.202 --> 01:44:03.642
<v Meredith Whittaker>there's really no danger for Signal here because we are very,

01:44:03.762 --> 01:44:05.542
<v Meredith Whittaker>very far away from Telegram.

01:44:05.822 --> 01:44:10.102
<v Meredith Whittaker>And we have set ourselves up so that one, such cooperation isn't required.

01:44:10.302 --> 01:44:13.162
<v Meredith Whittaker>And two, such cooperation is not possible.

01:44:13.642 --> 01:44:16.902
<v Meredith Whittaker>Because we literally, like you could put a gun to my head, I don't have that

01:44:16.902 --> 01:44:21.062
<v Meredith Whittaker>data. Whereas Telegram has servers and servers and servers full of that data.

01:44:22.455 --> 01:44:26.515
<v Tim Pritlove>Leaving out Signal completely now, what do you think happened?

01:44:26.935 --> 01:44:31.295
<v Tim Pritlove>Pawelldorf was put into custody. He's now free on bail.

01:44:31.595 --> 01:44:35.155
<v Tim Pritlove>And France talked to him.

01:44:35.375 --> 01:44:38.635
<v Meredith Whittaker>I have no idea. I mean, this is like...

01:44:38.635 --> 01:44:40.415
<v Linus Neumann>Didn't he send you like a telegram message?

01:44:40.775 --> 01:44:41.915
<v Meredith Whittaker>I haven't checked.

01:44:43.335 --> 01:44:44.655
<v Tim Pritlove>You missed his story.

01:44:44.955 --> 01:44:45.275
<v Linus Neumann>Yeah.

01:44:45.275 --> 01:44:48.495
<v Meredith Whittaker>I mean, this is like overlaid the French legal system.

01:44:48.495 --> 01:44:54.075
<v Meredith Whittaker>I am not a lawyer, especially not in France. Some of the vagaries of their legal

01:44:54.075 --> 01:44:55.795
<v Meredith Whittaker>system in which, you know,

01:44:56.315 --> 01:45:01.775
<v Meredith Whittaker>any judge can open an investigation and the basis for the charges will not be

01:45:01.775 --> 01:45:03.635
<v Meredith Whittaker>known until, you know, trial.

01:45:03.875 --> 01:45:08.475
<v Meredith Whittaker>And we're looking at years and years until then, with me not speaking French

01:45:08.475 --> 01:45:13.755
<v Meredith Whittaker>well at all with like weird translation, you know, like, so I want to stay away

01:45:13.755 --> 01:45:14.835
<v Meredith Whittaker>from speculating there.

01:45:14.835 --> 01:45:18.375
<v Meredith Whittaker>But what it looks like based on the charges that were released in the press

01:45:18.375 --> 01:45:23.015
<v Meredith Whittaker>release is that it was, you know, failure to comply with requests for data and

01:45:23.015 --> 01:45:27.635
<v Meredith Whittaker>then, you know, kind of a handful of other charges added on that aren't as severe as those.

01:45:28.715 --> 01:45:31.155
<v Tim Pritlove>So does Signal get these requests too?

01:45:31.155 --> 01:45:38.415
<v Meredith Whittaker>You can go to Signal.org slash Big Brother and every request that we have been

01:45:38.415 --> 01:45:43.615
<v Meredith Whittaker>forced to comply with because we fight them and have unsealed are posted there

01:45:43.615 --> 01:45:50.095
<v Meredith Whittaker>showing exactly how close to no data we are able to turn over and showing,

01:45:50.395 --> 01:45:53.655
<v Meredith Whittaker>and I think this is interesting for some of your listeners probably,

01:45:53.655 --> 01:45:58.415
<v Meredith Whittaker>You see what the law enforcement agencies in these requests are requesting,

01:45:58.515 --> 01:46:01.095
<v Meredith Whittaker>and it's often huge lists,

01:46:01.435 --> 01:46:07.015
<v Meredith Whittaker>massive amounts of data, which gives you a sense of just how much data surveillance,

01:46:07.255 --> 01:46:11.155
<v Meredith Whittaker>like a telegram or another platform,

01:46:11.515 --> 01:46:14.635
<v Meredith Whittaker>is commonly able to provide that Signal is not.

01:46:15.984 --> 01:46:24.344
<v Linus Neumann>Oh, so it's actually every single request. I thought it would maybe be aggregated.

01:46:24.764 --> 01:46:30.484
<v Meredith Whittaker>Yeah, no, it's PDFs of the request. It's not a transparency report, it's transparency.

01:46:35.844 --> 01:46:36.704
<v Tim Pritlove>I like that.

01:46:38.264 --> 01:46:41.504
<v Meredith Whittaker>Although it's just the ones that we can unseal, so we do have to go through that.

01:46:41.504 --> 01:46:46.004
<v Linus Neumann>I would assume there are probably some with gag orders, right? be able to say?

01:46:46.204 --> 01:46:49.264
<v Meredith Whittaker>There's no gag order on me being able to say.

01:46:49.884 --> 01:46:54.684
<v Meredith Whittaker>And there are some, but that's the fight to unseal it. And what I don't recall

01:46:54.684 --> 01:46:58.324
<v Meredith Whittaker>the answer for right now is whether we're in one of those fights right now or not.

01:46:58.424 --> 01:47:00.984
<v Meredith Whittaker>But I'd have to check with my friends at the ACLU.

01:47:05.404 --> 01:47:09.004
<v Tim Pritlove>So Signal as a company, how does it work?

01:47:10.164 --> 01:47:13.984
<v Meredith Whittaker>It's a non-profit. So we're funded by donations only

01:47:13.984 --> 01:47:16.664
<v Meredith Whittaker>only yeah um and we

01:47:16.664 --> 01:47:19.644
<v Meredith Whittaker>are thinking about in the future maybe having a

01:47:19.644 --> 01:47:22.924
<v Meredith Whittaker>paid tier for some features something like backups encrypted

01:47:22.924 --> 01:47:28.244
<v Meredith Whittaker>backups which we're you know building right now um you know could we charge

01:47:28.244 --> 01:47:33.724
<v Meredith Whittaker>people for media storage or other expensive features but um you know that would

01:47:33.724 --> 01:47:38.644
<v Meredith Whittaker>be in addition to donations and squarely within the non-profit structure that

01:47:38.644 --> 01:47:41.344
<v Meredith Whittaker>keeps us safe from pressure to surveil.

01:47:42.064 --> 01:47:47.664
<v Tim Pritlove>And how do you get your talent? How do you get people to work for Signal?

01:47:48.164 --> 01:47:53.644
<v Meredith Whittaker>We pay very well. And we are, I mean, it's a really cool mission, right?

01:47:53.904 --> 01:47:58.924
<v Meredith Whittaker>So imagine the jobs in tech are kind of depressing in many cases.

01:47:59.304 --> 01:48:03.404
<v Meredith Whittaker>Not everyone wants to go optimize an ad server and then Signal,

01:48:04.464 --> 01:48:10.304
<v Meredith Whittaker>you know, Signal you can work for core infrastructure for dissent and human

01:48:10.304 --> 01:48:15.144
<v Meredith Whittaker>rights work and journalism around the world that, you know, without which a

01:48:15.144 --> 01:48:17.604
<v Meredith Whittaker>lot of those things would be deeply imperiled.

01:48:17.764 --> 01:48:23.724
<v Meredith Whittaker>Like it's a real cool thing to get to do and support. And we pay well.

01:48:23.984 --> 01:48:29.124
<v Linus Neumann>So not only do you get respected for your six-digit salary, but for doing good

01:48:29.124 --> 01:48:30.624
<v Linus Neumann>thing, earning that money.

01:48:30.624 --> 01:48:32.504
<v Meredith Whittaker>Es ist die original Silicon Valley dream.

01:48:34.664 --> 01:48:39.444
<v Tim Pritlove>So ist es der letzte Platz in tech where people are actually happy?

01:48:40.664 --> 01:48:47.024
<v Meredith Whittaker>Well, I would never presume to speak to the consciousness of another person without there.

01:48:47.524 --> 01:48:52.984
<v Meredith Whittaker>But I think, yeah, I am very happy. I think a lot of the people who are at Signal are very happy.

01:48:53.184 --> 01:48:58.064
<v Meredith Whittaker>And I think it's also like we're kind of part of a project. And this is...

01:48:59.713 --> 01:49:04.753
<v Meredith Whittaker>Shows that what we have in tech, what's built in the tech industry is not inevitable.

01:49:05.633 --> 01:49:09.273
<v Meredith Whittaker>There's a series of choices, a series of incentives, a business model that has

01:49:09.273 --> 01:49:13.393
<v Meredith Whittaker>shaped tech into the form we have now, but it does not have to be that way, right?

01:49:13.513 --> 01:49:15.893
<v Meredith Whittaker>Like we can rewrite the stack, we can build alternatives.

01:49:16.253 --> 01:49:20.953
<v Meredith Whittaker>Nonprofits can work, right? We need capital, we need will, we need talent,

01:49:21.053 --> 01:49:22.093
<v Meredith Whittaker>we need all of those things.

01:49:22.493 --> 01:49:26.893
<v Meredith Whittaker>But the thing we have now is not inevitable. And I think of Signal as like a

01:49:26.893 --> 01:49:32.473
<v Meredith Whittaker>keystone species in the ecosystem, Kind of like, you know, like setting the

01:49:32.473 --> 01:49:36.093
<v Meredith Whittaker>bar, kind of regulating the rest, right? Like, you know, you can have privacy.

01:49:36.313 --> 01:49:39.593
<v Meredith Whittaker>You can have, you know, the right to private communications.

01:49:39.793 --> 01:49:42.793
<v Meredith Whittaker>You can subsist outside of this paradigm.

01:49:43.233 --> 01:49:47.413
<v Meredith Whittaker>And I think the future I want is that it's not just Signal, right?

01:49:47.593 --> 01:49:52.913
<v Meredith Whittaker>There are many, many other organizations and efforts sort of doing it differently,

01:49:53.193 --> 01:49:57.433
<v Meredith Whittaker>rejecting that paradigm, you know, drawing in capital there and,

01:49:57.573 --> 01:49:59.173
<v Meredith Whittaker>you know, away from the other place.

01:49:59.233 --> 01:50:04.993
<v Meredith Whittaker>Und beginnt zu marscheln die type of political will that is often very shallow

01:50:04.993 --> 01:50:09.913
<v Meredith Whittaker>like the 500 million AI fund but marscheln it for something that is actually

01:50:09.913 --> 01:50:11.153
<v Meredith Whittaker>substantive and is actually,

01:50:12.093 --> 01:50:18.393
<v Meredith Whittaker>making the kind of change to the tech ecosystem that I think we need to have a livable world.

01:50:18.393 --> 01:50:23.933
<v Tim Pritlove>You mean not only a model for other communication companies but also a model

01:50:23.933 --> 01:50:27.393
<v Tim Pritlove>for any kind of technology company?

01:50:28.573 --> 01:50:36.753
<v Meredith Whittaker>Ja, well, I mean, we build a communications app, but we rely on telecom networks.

01:50:37.273 --> 01:50:43.273
<v Meredith Whittaker>We rely on server infrastructure. We rely on core libraries.

01:50:43.513 --> 01:50:49.653
<v Tim Pritlove>That's not what I meant. I mean, I understood you that you think that the modus

01:50:49.653 --> 01:50:59.573
<v Tim Pritlove>operandi of Signal as a company might be something that other companies could also leverage and do.

01:51:00.153 --> 01:51:04.493
<v Tim Pritlove>It's not only limited to some much-needed device.

01:51:04.793 --> 01:51:11.613
<v Meredith Whittaker>I do think that there's a model there. I think I'm interested right now in researching

01:51:11.613 --> 01:51:13.713
<v Meredith Whittaker>hybrid structures and tandem structures.

01:51:13.853 --> 01:51:15.993
<v Meredith Whittaker>Are there sort of for-profit,

01:51:17.693 --> 01:51:25.293
<v Meredith Whittaker>Are there areas of tech that aren't driven by surveillance?

01:51:26.393 --> 01:51:30.933
<v Meredith Whittaker>Are there ways you could fund nonprofits, fund some of this core infrastructure,

01:51:31.153 --> 01:51:35.153
<v Meredith Whittaker>libraries and other things that have been languishing for decades?

01:51:35.393 --> 01:51:41.253
<v Meredith Whittaker>How do you revitalize that? And then are there, you know, are there ways to

01:51:41.253 --> 01:51:44.553
<v Meredith Whittaker>build truly independent infrastructure outside of the, you know,

01:51:44.933 --> 01:51:49.093
<v Meredith Whittaker>three companies, five platforms model that, like, I think it's just clearly

01:51:49.093 --> 01:51:50.673
<v Meredith Whittaker>critically dangerous at this point.

01:51:53.033 --> 01:51:59.953
<v Linus Neumann>So, when it's about building infrastructures in our hands, that's not going

01:51:59.953 --> 01:52:03.633
<v Linus Neumann>to be easier in an AI world, right?

01:52:03.733 --> 01:52:09.553
<v Linus Neumann>Where it's model data that we need, huge investments into these models just

01:52:09.553 --> 01:52:11.993
<v Linus Neumann>for training, then for operating them.

01:52:12.493 --> 01:52:19.213
<v Linus Neumann>Do you see any future for this whole AI thing in users' hands,

01:52:19.353 --> 01:52:27.293
<v Linus Neumann>in our hands, serving our actual privacy needs and let's say private and business needs?

01:52:27.973 --> 01:52:35.853
<v Meredith Whittaker>Well, I think my answer to that is that that future will rely on laying an independent

01:52:35.853 --> 01:52:40.533
<v Meredith Whittaker>infrastructural bedrock and actually transforming some of the way we govern

01:52:40.533 --> 01:52:43.453
<v Meredith Whittaker>and think about digital technology generally,

01:52:44.913 --> 01:52:49.693
<v Meredith Whittaker>Including being really attentive to things like how is data created?

01:52:50.073 --> 01:52:55.653
<v Meredith Whittaker>Who gets to decide what data we use to reflect our complex lives and realities?

01:52:56.033 --> 01:53:01.833
<v Meredith Whittaker>Who gets to decide how patterns in that data are made sense of?

01:53:01.993 --> 01:53:06.053
<v Meredith Whittaker>What analysis is done to that data? And then what we do with the sense we make

01:53:06.053 --> 01:53:08.393
<v Meredith Whittaker>of it, right? What decisions we make, right? And so...

01:53:10.328 --> 01:53:13.788
<v Meredith Whittaker>We do all that, we transform what AI is and what it means.

01:53:14.848 --> 01:53:19.048
<v Meredith Whittaker>Because you're no longer just scraping all the detritus off the stupid web,

01:53:19.088 --> 01:53:22.828
<v Meredith Whittaker>which was deposited or created via this surveillance business model,

01:53:23.568 --> 01:53:26.928
<v Meredith Whittaker>packaging that in an LLM and calling that intelligence, right?

01:53:26.968 --> 01:53:32.928
<v Meredith Whittaker>You're actually having to grapple with the epistemic process by which data becomes

01:53:32.928 --> 01:53:38.108
<v Meredith Whittaker>a proxy for reality, and that proxy shapes our lives and institutions.

01:53:38.628 --> 01:53:43.808
<v Meredith Whittaker>And so I think AI itself, right now we're talking about these massive models, right?

01:53:43.988 --> 01:53:49.628
<v Meredith Whittaker>This laws of scale, this sort of like big American guy dream of the,

01:53:49.648 --> 01:53:51.148
<v Meredith Whittaker>you know, the largest in the world.

01:53:52.328 --> 01:53:56.268
<v Meredith Whittaker>But AI is a, you know, it's a very slippery term. It's not a technical term

01:53:56.268 --> 01:53:59.968
<v Meredith Whittaker>of art. It can apply to many, many different things. And there are small models.

01:54:00.128 --> 01:54:03.548
<v Meredith Whittaker>There are sort of, you know, heterodox approaches. There are expert systems,

01:54:03.568 --> 01:54:06.248
<v Meredith Whittaker>which they're now trying to bolt onto the side of generative systems.

01:54:06.248 --> 01:54:10.508
<v Meredith Whittaker>Because weight, probabilistic answers aren't true, so we need to bolt truth

01:54:10.508 --> 01:54:15.988
<v Meredith Whittaker>back on and we're kind of repeating a lot of the history of AI,

01:54:16.168 --> 01:54:18.448
<v Meredith Whittaker>kind of speedrunning it in the search for a business model.

01:54:19.308 --> 01:54:23.348
<v Meredith Whittaker>So my answer there is that a lot of the things that need to be done to simply

01:54:23.348 --> 01:54:29.288
<v Meredith Whittaker>disarm and draw down the centralized power of these surveillance and infrastructure companies

01:54:29.708 --> 01:54:34.088
<v Meredith Whittaker>are the same things that would need to be done to redefine, in a sense,

01:54:34.168 --> 01:54:41.428
<v Meredith Whittaker>what AI is and our relationship to how truth, how, you know,

01:54:42.188 --> 01:54:45.488
<v Meredith Whittaker>decisions, how, you know, I don't want to use the word truth actually,

01:54:45.648 --> 01:54:51.008
<v Meredith Whittaker>but like how information is made via analyzing data and who gets to control that.

01:54:51.168 --> 01:54:54.828
<v Meredith Whittaker>And I think, you know, my sensitivity to data in that answer comes directly

01:54:54.828 --> 01:54:56.348
<v Meredith Whittaker>from my measurement experience, right?

01:54:56.448 --> 01:55:02.268
<v Meredith Whittaker>Like where you, you know, one upgrade to the Linux kernel across our server

01:55:02.268 --> 01:55:05.048
<v Meredith Whittaker>fleet fundamentally changed.

01:55:05.308 --> 01:55:09.648
<v Meredith Whittaker>The kind of data we were able to create, like how it populated the schema.

01:55:10.628 --> 01:55:15.768
<v Meredith Whittaker>And meant that that data wasn't necessarily fungible with the data collected

01:55:15.768 --> 01:55:19.508
<v Meredith Whittaker>on the older version of the kernel, right?

01:55:19.748 --> 01:55:23.288
<v Meredith Whittaker>And in order to solve that problem, I had to get a guy to go sit with the kernel

01:55:23.288 --> 01:55:27.748
<v Meredith Whittaker>maintainers for like two years to make sure that the update wasn't going to

01:55:27.748 --> 01:55:30.368
<v Meredith Whittaker>fuck up the way we got TCB DOMS, basically.

01:55:30.368 --> 01:55:34.028
<v Meredith Whittaker>Um so like that you know that's and

01:55:34.028 --> 01:55:37.048
<v Meredith Whittaker>that's that's then think about social

01:55:37.048 --> 01:55:39.928
<v Meredith Whittaker>data then think about data that reflects like who gets

01:55:39.928 --> 01:55:42.948
<v Meredith Whittaker>access to resources then think about all of the other things and um

01:55:42.948 --> 01:55:48.308
<v Meredith Whittaker>i think i think it's actually an exciting idea to think on like you know how

01:55:48.308 --> 01:55:52.128
<v Meredith Whittaker>do we how do we create systems where we're much more attentive to that and recognize

01:55:52.128 --> 01:55:56.328
<v Meredith Whittaker>that there is a you know it really matters how those choices are made how those

01:55:56.328 --> 01:56:00.148
<v Meredith Whittaker>you know how data is created who gets a und wie es zu sagen ist, und wie es zu sagen ist.

01:56:01.351 --> 01:56:09.851
<v Linus Neumann>Would you say in that future, so there is these large gen AI models and whatnot,

01:56:10.151 --> 01:56:15.891
<v Linus Neumann>and from other discussions we've had, I know that you probably believe there

01:56:15.891 --> 01:56:23.951
<v Linus Neumann>is a stronger future for specialized models, expert models, not the generative ones.

01:56:24.131 --> 01:56:30.671
<v Linus Neumann>Would that be a prediction of how this whole AI thing is going to evolve?

01:56:30.671 --> 01:56:35.511
<v Linus Neumann>Not from the business model perspective or from the political perspective but

01:56:35.511 --> 01:56:40.391
<v Linus Neumann>from the actual technology and research perspective.

01:56:40.391 --> 01:56:46.191
<v Linus Neumann>Do you think there is still going to be exponential improvement in the Gen AI

01:56:46.191 --> 01:56:50.071
<v Linus Neumann>world or do you think it's now the time for the smaller speedboats?

01:56:50.451 --> 01:56:55.191
<v Meredith Whittaker>Well, I think it's definitely time for smaller speedboats and I want to index

01:56:55.191 --> 01:56:59.771
<v Meredith Whittaker>on that word improvement because if we scratch the surface on some of these large models,

01:56:59.771 --> 01:57:04.211
<v Meredith Whittaker>some of which are generative you begin to realize that a lot of the claims to

01:57:04.211 --> 01:57:11.351
<v Meredith Whittaker>improvement and accuracy are based on really narrow benchmarks and evaluations

01:57:11.351 --> 01:57:15.391
<v Meredith Whittaker>that don't reflect the performance of these models That's.

01:57:15.391 --> 01:57:17.791
<v Linus Neumann>How Germans optimize their diesel engines.

01:57:19.931 --> 01:57:23.471
<v Meredith Whittaker>Exactly So it's there

01:57:23.471 --> 01:57:28.691
<v Meredith Whittaker>are things that Gen AI models can do I don't see them realistically going away

01:57:28.691 --> 01:57:35.231
<v Meredith Whittaker>But I do see the struggle for a market fit that can produce the kinds of returns

01:57:35.231 --> 01:57:41.991
<v Meredith Whittaker>necessary to prop up a massively energy intensive,

01:57:42.431 --> 01:57:49.631
<v Meredith Whittaker>massively infrastructurally intensive, extraordinarily capital intensive industry, right?

01:57:49.631 --> 01:57:54.291
<v Meredith Whittaker>So you have billions of dollars for a training run, just huge amounts of energy

01:57:54.291 --> 01:57:56.011
<v Meredith Whittaker>and effort needed to create a model.

01:57:56.391 --> 01:58:01.091
<v Meredith Whittaker>But okay, who's going to keep paying for a chatbot that's wrong?

01:58:02.011 --> 01:58:05.031
<v Meredith Whittaker>And so I think there is a struggle for market fit.

01:58:05.131 --> 01:58:09.851
<v Meredith Whittaker>I think you see this with things like Microsoft Recall where they pushed to

01:58:09.851 --> 01:58:12.271
<v Meredith Whittaker>implement this. I don't know.

01:58:13.451 --> 01:58:17.751
<v Meredith Whittaker>Microsoft Recall was supposed to ship with Windows 11.

01:58:18.811 --> 01:58:21.071
<v Tim Pritlove>Es ist aber nicht auf der Default.

01:58:21.251 --> 01:58:26.611
<v Meredith Whittaker>Ja, wir haben das kleine Sache. Aber es ist ein AI-System, whose value proposition

01:58:26.611 --> 01:58:32.071
<v Meredith Whittaker>ist, dass es will remember everything you were doing on your device for the last N months.

01:58:32.771 --> 01:58:34.351
<v Linus Neumann>Das ist ein nice value proposition.

01:58:34.351 --> 01:58:40.871
<v Meredith Whittaker>Ich weiß, value to your boss, maybe. Und so you can type, oh,

01:58:40.931 --> 01:58:44.431
<v Meredith Whittaker>ich will find this browser, ich will find this thing, und es will...

01:58:45.813 --> 01:58:52.453
<v Meredith Whittaker>I get it for you. I obviously don't use it. And how does it remember is really the key here.

01:58:52.553 --> 01:58:56.773
<v Meredith Whittaker>It remembers because it's taking screenshots of your device every five seconds,

01:58:57.613 --> 01:59:02.433
<v Meredith Whittaker>creating a library of those screenshots and accessing those as the data on which

01:59:02.433 --> 01:59:05.133
<v Meredith Whittaker>it is able to claim intelligent memory.

01:59:05.273 --> 01:59:10.133
<v Linus Neumann>That is not an efficient way to approach the problem.

01:59:10.373 --> 01:59:13.493
<v Meredith Whittaker>And I don't need to know that I was doomscrolling. Like, you know,

01:59:13.593 --> 01:59:16.213
<v Meredith Whittaker>that's not a proud moment of memory for me.

01:59:16.373 --> 01:59:20.853
<v Meredith Whittaker>So, yeah, I mean, and to me what that says, like, that's not a very useful purpose.

01:59:21.053 --> 01:59:23.833
<v Meredith Whittaker>It's probably going to be marketed to enterprises for, you know,

01:59:24.033 --> 01:59:25.833
<v Meredith Whittaker>worker surveillance is my guess.

01:59:26.393 --> 01:59:30.893
<v Meredith Whittaker>But it shows that Microsoft is really trying to find a market for this, right?

01:59:31.033 --> 01:59:33.993
<v Meredith Whittaker>Because they clearly circumvented their QA process.

01:59:34.113 --> 01:59:37.013
<v Meredith Whittaker>They clearly circumvented their security evaluation. There was a lot of things

01:59:37.013 --> 01:59:41.913
<v Meredith Whittaker>that clearly didn't happen and didn't happen at a company that is actively...

01:59:44.073 --> 01:59:48.293
<v Meredith Whittaker>Die haben OpenAI, sie investieren eine große Menge in Azure,

01:59:48.413 --> 01:59:50.433
<v Meredith Whittaker>sie sind in der Infrastruktur überall, all of sie sind.

01:59:50.553 --> 01:59:56.013
<v Meredith Whittaker>Aber Microsoft ist joked zu OpenAI, so sie hat die Leader Position für ein Moment.

01:59:56.413 --> 02:00:00.253
<v Meredith Whittaker>Und ich denke, also, dass Microsoft

02:00:00.253 --> 02:00:04.853
<v Meredith Whittaker>ist wirklich zu regieren eine gute Reputation in der Security-World,

02:00:05.733 --> 02:00:12.113
<v Meredith Whittaker>es ist indicative of how desperate but that rush to market fit and the AI exceptionalism

02:00:12.113 --> 02:00:17.253
<v Meredith Whittaker>that is driving it is that they just mess that up so egregiously.

02:00:17.393 --> 02:00:20.913
<v Meredith Whittaker>And I can hear some hacker in a Microsoft hallway being like,

02:00:20.993 --> 02:00:22.833
<v Meredith Whittaker>I don't fucking know. I just left that meeting.

02:00:24.733 --> 02:00:27.313
<v Meredith Whittaker>Because you can kind of sense how those things happen.

02:00:27.493 --> 02:00:32.653
<v Tim Pritlove>What would you say is the dividing line right now between useful applications

02:00:32.653 --> 02:00:39.933
<v Tim Pritlove>for machine learning, expert systems, AI stuff, and the hype?

02:00:40.773 --> 02:00:46.473
<v Meredith Whittaker>Well, I mean, the question to dig into is useful to whom?

02:00:46.773 --> 02:00:50.953
<v Meredith Whittaker>Because hype is useful to investors, right? You know, yada yada.

02:00:51.053 --> 02:00:52.493
<v Tim Pritlove>I'm not talking about, yes.

02:00:52.853 --> 02:00:56.253
<v Meredith Whittaker>I mean, I think AI is...

02:00:56.253 --> 02:01:02.113
<v Tim Pritlove>In a computer science-y way. I mean, really like making applications possible

02:01:02.113 --> 02:01:07.273
<v Tim Pritlove>that haven't been before, that actually do useful stuff to people or society.

02:01:07.773 --> 02:01:10.553
<v Meredith Whittaker>Yeah, I mean, one use I think about a lot that is definitely,

02:01:10.793 --> 02:01:15.693
<v Meredith Whittaker>I'm sure, useful to intelligence services is, you know, I'm sure we all assume

02:01:15.693 --> 02:01:21.433
<v Meredith Whittaker>that POTS telephony data is being collected en masse by every intelligence service,

02:01:22.073 --> 02:01:24.853
<v Meredith Whittaker>who can and has been for many, many, many years,

02:01:25.853 --> 02:01:29.473
<v Meredith Whittaker>and that data was probably not that useful for a long time because,

02:01:29.613 --> 02:01:31.853
<v Meredith Whittaker>you know, you're going to have to know, you're going to have to have a human

02:01:31.853 --> 02:01:33.553
<v Meredith Whittaker>review it or, you know, something like,

02:01:34.819 --> 02:01:38.159
<v Meredith Whittaker>It's probably a lot more useful now that you can quickly transcribe that with

02:01:38.159 --> 02:01:42.159
<v Meredith Whittaker>AI and sort of synthesize and search using these generative systems, right?

02:01:42.479 --> 02:01:46.739
<v Meredith Whittaker>So that's one example where I think it's probably almost certainly very,

02:01:46.839 --> 02:01:50.759
<v Meredith Whittaker>very useful and changes the calculus on like how dangerous this surveillance

02:01:50.759 --> 02:01:52.239
<v Meredith Whittaker>business model is as well.

02:01:52.999 --> 02:01:55.339
<v Meredith Whittaker>But who is that useful to? It's not me and you.

02:01:58.339 --> 02:02:02.619
<v Tim Pritlove>Yeah, you're going right into surveillance capitalism again.

02:02:02.619 --> 02:02:05.119
<v Meredith Whittaker>No, well, that's my, I'm really good at making that turn.

02:02:07.459 --> 02:02:11.899
<v Tim Pritlove>I'm looking for a rosy outlook into the future, like hope.

02:02:12.399 --> 02:02:13.599
<v Meredith Whittaker>Yeah, well, I mean.

02:02:13.879 --> 02:02:14.859
<v Tim Pritlove>Anything in store?

02:02:15.359 --> 02:02:20.219
<v Meredith Whittaker>I refuse to plant my hope in delusion.

02:02:22.759 --> 02:02:24.739
<v Linus Neumann>Okay, thanks, thanks.

02:02:25.919 --> 02:02:28.919
<v Meredith Whittaker>And I am probably one of the more optimistic people you'll meet.

02:02:32.619 --> 02:02:33.159
<v Tim Pritlove>All right.

02:02:33.359 --> 02:02:34.759
<v Linus Neumann>Meredith, it was a pleasure.

02:02:34.999 --> 02:02:38.419
<v Meredith Whittaker>So fun. Always so fun. Thank you for having me. It's been a really,

02:02:38.439 --> 02:02:40.579
<v Meredith Whittaker>really delightful conversation with you all.

02:02:41.339 --> 02:02:47.499
<v Tim Pritlove>All right. Thank you. Thanks for listening and see you next week. Goodbye.

02:02:47.899 --> 02:02:48.159
<v Linus Neumann>Bye-bye.
