YouSaid · the spoken record

Max Tegmark

lines on the record: 189
first: 2023-04-13
most recent: 2023-04-13
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“You don't want to be enacting all these principles, then you abide by them, and then there's this one little company that... Don't sign on to it, and then now they can gradually overtake you, then the companies will get. Be able to sleep secure, knowing that everybody is playing by the same rules.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Can get these people coming up. So here's a white paper. Here's where we all think it's reasonable. Just because cars killed a lot of people, you didn't ban cars, but they got together a bunch of people and decided, you know, in order to be allowed to sell a car, it has to have a seat belt in it. The analogous things that you can start requiring a future AI systems so that they are safe. And once this heavy lifting, this intellectual work has been done by experts in the field, which can be done quickly, I think it's going to be quite easy to get policymakers to see, yeah, this is a good idea. For the companies to fight Moloch. They want, and I believe Sam Altman has explicitly called for this, they want the regulators to actually adopt it so that their competition is going to abide by it too, right? You don't want...”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I think both, but I think that the vision, the path to success that I see is first you give a breather actually to the people in these companies, their leadership who wants to do the right thing and they all have safety teams and so on on their companies, give them a chance to Together with the other companies. And the outside pressure can also help catalyze that, right? And the workout. What is it that's What are the reasonable safety requirements one should put on future systems before they get rolled out? There are a lot of people also in academia and elsewhere outside of these companies who can be brought into this and have a lot of very good ideas. And then I think it's very realistic that within six months”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“It's not enough to align the incentives of individual people or align individual computers' incentives to their owners, which is what technically i safety research is about. You also have to align the incentives to corporations with a greater good. And some corporations have gotten so big and so powerful very quickly that in many cases there are lobbyists instead align the regulators to what they want rather than the other way around. the classic regulatory capture.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“But the challenge you're facing is that the tech is generally much faster than what the policymakers are And a lot of the policymakers also don't have tech background. So we really need to work hard to educate them on what's taking place here. So we're getting this situation where the first kind of non, so I define artificial intelligence just as non-biological intelligence And by that definition, A corporation is also an artificial intelligence because the corporation isn't its humans, it's the system. If its CEO decides the CEO of a tobacco company decides one morning that she or he doesn't want to sell cigarettes anymore, they'll just put another CEO in there.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Some lobbyists pushed successfully for this. So we were actually quite involved with the Future Life Institute. Mark Brakel, Risto Ok, Anthony Agir, and others, you know, were quite involved with talking to educating various people involved in this process about These general purpose AI models coming and pointing out that they would become the laughing stock if they didn't put it in. The French started pushing for it. It got put in to the draft. And it looked like all was good. And then there was a huge counterpush from lobbyists. There were more lobbyists in Brussels from tech companies than from oil companies, for example. And it looked like it maybe get taken out again. And now GPT-4 happened. And I think it's going to stay in. But this just shows, you know, Moloch can be defeated.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Eating like really crappy food in a small room. I'm just going to chill out. And we similarly have tried to give these incentives to our corporations by having regulation and all sorts of oversight so that their incentives are aligned with the greater good. We tried really hard. And the big problem that we're failing now It's not that we haven't tried before, but it's just that the tech is growing much faster than the regulators been able to keep up, right? Regulators, it's kind of comical. The European Union right now is doing this AI Act. And in the beginning, they had a little opt-out exception that GPT-4 would be completely excluded from regulation. Brilliant idea”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“It really discourages liars, moochers, cheaters, because their own incentive now is not to do this because word quickly gets around and then suddenly people aren't going to invite them to their dinners anymore or trust them. And then when we got still more sophisticated and bigger societies invented the legal system where even strangers who couldn't rely on gossip and things like this would treat each other would have an incentive now those guys in the bar fights, even if someone is so drunk that he... Actually, wants to kill the other guy He also has a little thought on the back of his head that do I really want to spend the next 10 years?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“And similarly, if you find a baby lying on the street when you go out for your morning jog tomorrow, you're going to stop and pick it up, right? Even though it may make you late for your next podcast. So evolution gave us these genes that make our own egoistic incentives more aligned with what's good for the greater group we're part of, right? And then as we got a bit more sophisticated and developed language. Invented gossip, which is also a fantastic anti Moloch because now”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Number one or number two enemy since the beginning of civilization. And we came up with some really cool countermeasures. First of all, already over 100,000 years ago, evolution realized that it was very unhelpful that people kept killing each other all the time. So genetically gave us compassion. And made it so that if you get two drunk dudes getting into a pointless bar fight. They might give each other black eyes, but they have a lot of inhibition towards just killing each other.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“We can do this with AI too. The thing is, we haven't succeeded yet. And Moloch is exactly. Doing the opposite, just fueling, just egging everybody on faster, faster, faster, or the other company is going to catch up with you or the other country is going to catch up with you. We have to want to stop. And I don't believe in this just asking people to look into their hearts and do the right thing. It's easier for others to say that. But if you're in a situation where your company is going to get screwed. By other companies that are not stopping, you're putting people in a very hard situation. The right thing to do is change the whole incentive structure instead. And this is not an old maybe I should say one more thing about this because Moloch has been around as humanities.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Steph Lloyd wrote a really cool paper on the physical limits on computation. For example, if you make it, put too much energy into it and finite space, it'll turn into a black hole. You can't move information around fast than the speed of light, stuff like that. It's hard to store way more than a modest number bits per atom, etc. But those limits are just astronomically above, like 30 orders of magnitude above where we are now. Bigger, different, bigger jump in intelligence than if you go from an ant to a human. Course, what we want to do is have a controlled thing. A nuclear reactor, you put moderators in to make sure exactly it doesn't blow up out of control, right? When we do... Experiments with biology and cells, and so on. We also try to make sure it doesn't get out of control.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Obviously, going to stop when it bumps up against the laws of physics. There are some things you just can't do no matter how smart you are, right? Because we don't”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“All explosions are like that, and an intelligence explosion is just exactly the same principle that some quantity, some amount of intelligence can make more intelligence than that, and then repeat. You always get exponentials.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“These sort of human level tools can cause a gradual acceleration. You keep using yesterday's technology to build tomorrow's technology. And Over and over again, you naturally get an explosion. That's the definition of an explosion in science, right? If you have People and they fall in love. Now you have four people and then they can make more babies and now you have eight people and then you have 16, 32, 64, etc. We call that a population explosion where it's just that each, if it's instead free neutrons in a nuclear reaction, if each one can make more than one, then you get an exponential growth in that. We call it a nuclear explosion”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Figure out what action to take based on its goals that it has and then does something back on the world. But once you have an API, for example, GPT-4, nothing stops Joe Schmoe and a lot of other people from building real agents, which just keep making calls somewhere in some inner loop somewhere to these powerful Oracle systems Which makes themselves much more powerful. That's another kind of unfortunate development, which I think we would have been better off delaying. I don't want to pick on any particular companies. I think they're all under a lot of pressure to make money. Again, the reason we're calling for this pause is to give them all cover to do what they know is the right thing. Slow down a little bit at this point. Everything we've talked about, I hope, will make it clear that people watching this, why?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I was kind of lying on my psychiatrist, imagining I'm on a psychiatrist's couch here saying, What are my fears that people would do with AI systems So I mentioned three that I had fears about many years ago that they would do, namely teach at the code connect it to the internet and teach it to manipulate humans. A fourth one is building an API. Where code can control this super powerful thing, right? That's very unfortunate. Because one thing that systems like GPT-4 have going for them is that they are an Oracle in the sense, that they just answer questions. There is no robot connected to GPT-4. GPT-4 can't go and do stock trading based on its thinking. Is not an agent, an intelligent agent is something that takes in in information from the world, processes it.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Faster. So, if that's typical for programmers, then you're already seeing another kind of recursive self-improvement, right? Because previously, one, like a major generation of improvement of the codes would happen at the human R&D timescale. And now if that's five times shorter. It's going to take five times less time than it otherwise would to develop the next level of these tools and so on. So this is exactly the sort of beginning of an intelligence explosion. There can be humans in the loop a lot in the early stages and then eventually humans are needed less and less and the machines can more kind of go alone. But what you said there is just an exact example of these sort of things. Another thing.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I feel we have to remember. As individuals, we should from time to time ask ourselves why are we doing what we're doing, and as a species, we need to do that too. So if we're building, as you say, machines that are outnumbering us and more and more outsmarting us and replacing us on the job market, not just for the dangerous and boring tasks, but also for writing poems and doing art and things that a lot of people find really meaningful, you've got to ask ourselves why are we doing this? The answer is Moloch is tricking us into doing it. And it's such a clever trick that even though we see the trick, we still have no choice but to fall for it, right? Also, the thing you said about you using co pilot. AI tools to program faster. How many times? What factor faster would you say you code now? Does it go twice as fast”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Consume become a little bit more like Life 3.0, and that if they need more hardware, hey, just rent it in the cloud. How do you pay for it? Well, with all the services you provide.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Because it's life 2.0, the systems I'm afraid of are going to look nothing like a large language model and they're not. Once it or other people figure out a way of using this tech to make much better tech, it's just constantly replacing its software. And from everything we've seen about how these work under the hood, they're like the minimum viable intelligence. They do everything in the dumbest way that still works, sort of. So, they are live 3.0, except when they replaced their software, it's a lot faster than when you decide to learn Swedish. And moreover, they think a lot faster than us too. So when, you know, We don't think one. Logical step every nanosecond or so the way they do. And we can't also just suddenly scale up our hardware massively in the cloud, which is so limited, right? So they are also life.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“And it's going to grow up. There's going to be other systems from the same company, from other companies. They'll be way more powerful, but they're going to take all the things, ideas from these babies. And before we know it, we're going to be like... I was last Neanderthals who were pretty disappointed when they realized that they were getting replaced.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Super Neanderthal intelligences, and there won't be any Neanderthals left. But then you have a bunch of others in the cave, bro. Are you such a Luddite scaremonger? Of course, they're going to want to keep us around because we are their creators. And the smarter, I think the smarter they get, the nicer they're going to get. They're going to leave us around and it's going to be fine. And besides, look at these babies. They're so cute. Clearly they're totally harmless. Those babies are exactly GPT-4. It's not, I want to be clear, it's not GPT 4. That's terrifying. It's the GPT-4 as a baby technology. And Microsoft even had a paper recently out. With a title Something like Sparkles of AGI, what they were basically saying this is baby AI like these little Neanderthal babies.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“You might say, hey, Max, yeah, let's build these Homo sapiens. They're going to be smarter than us. Maybe they can help us defend us better predators and help fix up our caves, make them nicer. We'll control them, undoubtedly. So then they build a couple, a little baby girl, a little baby boy. And then you have some wise old and Neanderthal elder who's like, hmm, I'm scared that we're opening a Pandora's box here and that we're going to get outsmarted by”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I mean, in the long term, it's not a good investment for anyone to have a nuclear war, for example And is it a good investment for humanity if we just ultimately replace all humans by machines and then we're so obsolete that eventually the... No humans Well, it depends against how you do the math, but I would say by any reasonable economic standard, if you look at the future income of humans and there aren't any, you know, that's not a good investment. Moreover, like why can't we have a little bit of pride in our species? Damn it. Why should we just build another species that gets rid of us? If we were Neanderthals, Would we really consider it a smart move if we had really advanced biotech to build homo sapiens?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Have a functional conversation in the public space. That's why I started the Improve the News Project, improve the news.org. But I'm an optimist fundamentally in... That there is a lot of intrinsic goodness in people and that what makes the difference between someone doing good things for humanity and bad things is not Some sort of fairy tale thing that this person was born with an evil gene, and this one was not born with a good gene. No, I think it's whether we put whether people find themselves in situations that bring out the best in them or they bring out the worst in them. And I feel we're building an internet. Of society that brings out the worst.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I think it's not only possible, but it's necessary. Who are we kidding that we're going to be able to solve all these other challenges if we can't even have a conversation with each other? It's constructive. The whole idea, the key idea of democracy is that you get a bunch of people together and they have a real conversation, the ones you try to foster on this podcast, or you respectfully listen to people you disagree with. And you realize, actually, you know, there are some things, actually, some common ground we have, and we both agree let's not have a nuclear war, let's not do that, et cetera, et cetera. Kidding ourselves thinking we can face off the second contact with ever more powerful AI that's happening now with these large language models if we can't even.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“And we humans often point fingers at other humans and say it's their fault. But it's really Moloch and these AI algorithms. We got the algorithms, and then The social media companies against each other, so nobody could have a less creepy algorithm because then they would lose out on revenue to the other company.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Exactly. And that is not something you think is in humanities interest Right now it's mainly letting some humans manipulate other humans for profit. Which already caused a lot of damage. And eventually, that's a sort of skill that can make AIs persuade humans to let them escape whatever safety precautions we have. But there was a really nice article in the New York Times recently by Yuval Noah Harari and two co-authors, including Tristan Harris from the Social Dilemma. We have this phrase in there I love humanity's first contact with advanced AI Social media. We lost that one Now, live in a country where there's much more hate in the world where there's much more hate, in fact. And in our democracy, that we're having this conversation and people can't even agree on who won the last election, you know.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Because they figured out that these algorithms not out of evil, but just to make money on advertising, that the best way to get more engagement, the euphemism, get people glued to their little rectangles, is just to make them pissed off.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Amazing AI researcher, he has argued for a while that we should never teach AI anything about humans. Above all, we should never let it learn about human psychology and how you manipulate humans. That's the most dangerous kind of knowledge you can give it. Yeah, you can teach it all it needs to know how to cure cancer and stuff like that, but don't let it read Daniel Kahneman's book about cognitive biases and all that. Oops, LOL, you know, let's invent social media. Recommend our algorithms which do exactly that. They get so good at knowing us and pressing our buttons. We're starting to create a world now where we just have ever more hatred.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Have to worry, obviously, developers once they get to really strong AI, first thing you're going to do is never connect it to the internet, keep it in the box where you can really study it. So he had written it in the meme forms, so it's like then. And then that now. LOL, let's make a chat spot.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“A lot of safety researchers have been saying for many years that the most dangerous things you can do with an AI is, first of all, teach it to write code. That's the first step towards recursive self improvement, which you can take it from AGI to much higher levels. Okay. Oops, we've done that. And another thing, high risk is connected to the internet. Let it go to websites, download stuff on its own, talk to people. We've done that already. You know, Elias Yukowski, you said you interviewed him recently, right? Yes. He had this tweet recently Gave me one of the best laughs in a while where he's like, Hey, people used to make fun of me and say, You're so stupid, Eliaser, because you're saying...”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“It's clear that we hope that was going to happen hasn't happened. The capability progress has gone faster than a lot of people thought and the progress in the public sphere of policymaking and so on has gone slower than we thought. Even the technical AI safety has gone slower. A lot of the technical safety research was kind of banking on that large language models and other poorly understood systems couldn't get us all the way, that you had to build more of a kind of intelligence that you could understand. Maybe it could prove itself safe, things like this. I'm quite confident that this can be done so we can reap all the benefits, but we cannot do it as quickly as this out of control express train we are on now is going to get the AGI. That's why we need a little more time, I feel.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“If it's created very, very soon and is a big black box that we don't understand, like the large language models, yeah, then I'm very confident they're going to lose control. But this isn't just me saying it. Sam Altman and Demis Asabist have both said. themselves acknowledge that there's really great risks with this and they want to slow down once they feel it gets scary it's but it's clear that they're stuck in this again Moloch is forcing them to go a little faster than they're comfortable with because of pressure from just commercial pressures right to get a bit optimistic here of course this is a problem that can be ultimately solved Just to win this wisdom race.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Continue developing awesome AI a little bit slower so we make it safe, make sure it does the things that humans want and create a condition where everybody wins. Technology has shown us that geopolitics and politics in general is not a zero-sum game at all.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“If you live in Orwellian dystopia, what do you care who's created it, right? And if it goes farther and... We just lose control even to the machines. So that it's not us versus them, it's us versus it. What do you care who created this unaligned entity which has goals different from humans ultimately and we get marginalized, we get made obsolete, we get replaced. That's what I mean when I say it's a suicide race. It's kind of like we're rushing towards this cliff, but the closer to the cliff we get, the more scenic the views are and the more money there is there. So we keep going. But we have to also stop at some point, right? Quit while we're ahead. A suicide race which cannot be won, but the way to really benefit from it is.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Very superhuman because they think there's something really magical about intelligence such that it can only exist in human minds. Because they believe that, I think it's going to kind of get to just more or less GPT 4, and then that's it. Don't see it as a suicide race. They think whoever gets that first, they're going to control the world, they're going to win. That's not how it's going to be. And we can talk again about the scientific arguments for why it's not going to stop there. But the way it's going to be is if anybody completely loses control and you don't care if someone manages to take over the world who really doesn't share your goals, you probably don't really even care very much about what nationality they have. You're not going to like it much worse than today.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Not because Westerners said, China, look, this is no, the Chinese government put them there because they also felt they like control, the Chinese government. If anything, maybe they are even more concerned about having control than Western governments have no incentive of just losing control over where everything is going. And you can also see the Ernie bot that was released, I believe, Baidu recently. They got a lot of pushback from the government and had to rein it in a big way. I think once this basic message comes out that this isn't an arms race, it's a suicide race Everybody loses if anybody's AI goes out of control. It really changes the whole dynamic. I'll say this again because this is this very basic point I think a lot of people get wrong because a lot of people dismiss the whole idea that AI can really get”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“And in China undoubtedly, they also get told we can't slow down because the West, because both sides think they're the good guy. But look at human cloning. Did China forage ahead with human cloning? There's been exactly one human cloning that's actually been done that I know of. It was done by a Chinese guy. Do you know where he is now? Jail You know who put him there Chinese”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“The mallock. Absolutely. And even like human cloning, for example, you could make so much money on human cloning. Why aren't we doing it Because biologists thought hard about this and felt like this is way too risky. They got together in the 70s in the Cilimar and decided even Stop a lot more stuff also, just editing the human germline, gene editing that goes in. Our offspring Decided let's not do this because it's too unpredictable what it's going to lead to. We could lose control over what happens to our species. So they paused There was a ton of money to be made there. So it's very doable, but you just need a public awareness of what the risks are and the broader community coming in and saying, hey, let's slow down. And another common pushback I get today is we can't stop in the West because China.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“OpenAI is very close with Microsoft now. And there are plenty of smaller players. For example, Anthropic is very impressive. There's conjecture. There's many, many, many players. I don't want to make a long list to leave anyone out. That reason it's so important that some coordination happens, that there's external pressure on all of them, saying you all need the pawns. Because then the researchers in these organizations, the leaders who want to slow down a little bit, they can say they're shareholders, you know. Everybody's slowing down because of this pressure, and it's the right thing to do.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Like, well, you know, if you pause, but those guys don't pause. If you don't want to get our lunch eaten, And shareholders even have the power to replace the executives in the worst case, right? We did this open letter because we want to help these idealistic tech executives to do what their heart tells them by providing enough public pressure on the whole sector to just pause so that they can all pause in a coordinated fashion. And I think without the public pressure, none of them can do it alone. Push back against their shareholders, no matter how goodhearted they are. Smolk is a really powerful foe.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Costly, right? Moloch is everywhere. And Moloch is not a new arrival on the scene either. We humans have developed a lot of collaboration mechanisms to help us fight back against Moloch through various kinds of constructive collaboration. The Soviet Union and the United States did sign a number of arms control treaties against Moloch who was trying to stoke them into unnecessarily risky nuclear arms races, et cetera, et cetera. And this is exactly what's happening on the AI front this time. A little bit geopolitics, but it's mostly money where there's just so much commercial pressure. If you take any of these leaders of the top tech companies If they just say, you know, this is too risky. I want to pause for six months, they're going to get a lot of pressure from shareholders and others.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Great. She made this awesome Recently, that beauty filters Lot of female Influencers feel pressured to use are exactly molloch in action again. First, nobody was using them. And people saw them just the way they were. And then some of them started using it. Becoming ever more plastic fantastic. And then the other ones that weren't using started to realize that if they want to just keep their market share, they have to start using it too. And then you're in a situation where they're all using it. And none of them has any more market share or less than before. So nobody gained anything. Everybody lost And they have to keep becoming ever more plastic fantastic also. But nobody can go back to the old way because it's just...”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, it's a beautiful essay on this poem by Ginsburg where he interprets it as being about this monster. This game theory monster that pits people against each other in this, that they race to the bottom where everybody ultimately loses the evil thing about this monster is even though everybody sees it and understands. They still can't get out of the race A good fraction of all the bad things that we humans do are caused by molloch. And I like Scott Alexander's naming of the monster. So humans can think of it as a thing. If you look at why do we have overfishing, why do we have more generally the tragedy of the commons? Why is it that live bore, I don't know if you've had her on your podcast”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“For the labs to coordinate a bit on safety and for society to adapt, give the right incentives to the labs. Because you've interviewed a lot of these people who lead these labs and you know just as well as I do that they're good people, they're idealistic people. They're doing this first and foremost because they believe that AI has a huge potential to help humanity. At the same time, they are trapped in this horrible race to the bottom. Have you read Meditations on Moloch by Scott Alexander?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“A lot of little leaps here and there because. Because so much of this is out in the open, also. So many smart people are looking at this and trying to figure out little leaps here and there, and it becomes this sort of collective race where if a lot of people feel if I don't take the leaps someone else with, and it is actually very crucial for the other part of it, why do we want to slow this down? Again, what this open letter is calling for is just pausing. All training. Of systems that are more powerful than GPT-4 for six months give a chance.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“But the way it's storing this information is incredibly dumb for any fellow nerds listening to this. There was a big matrix and roughly speaking there are certain row and column vectors which encode these things and they correspond very handwaily to principal components. And it would be much more efficient for sparse matrix to store in the database. And everything so far we've figured out how these things do are ways where you can see they can easily be improved. And the fact that this particular architecture has some roadblocks built into it is in no way going to prevent crafty researchers from quickly finding workarounds and making Other kinds of architectures sort of go all the way. So it's in short, it's turned out to be a lot easier to build close to human intelligence than we thought. And that means our runway as a species.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Change some of the synapses in it. And then they asked it, where is the Eiffel Tower? And it said, it's in Rome. And then they asked you, how do you get there? Oh, how do you get there from Germany? Oh, you take this train to Roma Termini train station and this and that. And what might you see if you're in front of it? Oh, you might see the Coliseum. So they had edits.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source