YouSaid · the spoken record

Max Tegmark

lines on the record: 189
first: 2023-04-13
most recent: 2023-04-13
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“Well, the honor is all mine, and I'm so grateful to you for making more people aware of the fact that humanity has reached its most important fork in the road ever in its history. And let's turn in the correct direction.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“It is fundamental because what we feel is so fundamental is suffering and joy and pleasure and meaning. Those are all subjective experiences there. And those are the elephant in the room. That's what makes life worth living. And that's what can make it horrible if it's just a bunch of suffering. So let's not make the mistake of saying that that's all bullshit.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“But if someone tells me, well, you know. Just an illusion to consciousness Whatever Like to invite them the next time they're having surgery to do it without anesthesia. What is anesthesia really doing? If you have it, you can have a local anesthesia when you're awake. I had that when they fixed my shoulder. It was super entertaining. What was that it did? It just removed my subjective experience of pain. It didn't change anything about what was actually happening in my shoulder, right? So, if someone says that's all bullshit Skip the anesthesia, is my advice. This is incredibly central.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I just want to say one more thing, which is super important. Most of my colleagues, when I started going on, and my consciousness tell me that it's all bullshit and I shall stop talking about it. Hear a little inner voice from my father and from my mom saying, Keep talking about it because I think they're wrong. The main way to convince people like that. They're wrong if they say that consciousness is just equal to intelligence, just ask them, what's wrong with torture? Why are you against torture? If it's just about These particles moving this way rather than that way. And there is no such thing as subjective experience. What's wrong with torture? I mean, do you have a good comeback to that?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Yes. So that's a happy thought for me because the zombie couple of apocalypse really is my worst nightmare of all. It would be like adding insult to injury. Not only did we get replaced, but we friggin replaced ourselves by zombies. How dumb can we be?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“My hunch is that if you want to fake that with a zombie system that just all goes one way, you have to like unroll those loops and it gets really, really long and it's much more inefficient. So I'm actually hopeful that AI in the future we have all these very sublime and interesting machines that do cool things and are aligned with us that they will be at least, they will also have consciousness for the kind of these things that we do.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Got in a little email saying Facial processing Task complete it's I just go with that, right? So this fits perfectly with Tononi's model because this was all one way information processing mainly. And it turned out for that particular task, that's all you needed. And it probably was kind of the most efficient way to do it. But there were a lot of other things that we associated with higher intelligence and planning and so on and so forth where you kind of want to have loops and be able to ruminate and self-reflect and introspect and so on.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Yes, if it's true, it's wonderful because then we don't have to fear the ultimate zombie apocalypse. And I think if you look at our brains, actually, our brains are part zombie and part conscious. When I open my eyes, I immediately. All these pixels that hit my retina, right? And like, oh, that's Lex. But I have no freaking clue of how I did that computation. It's actually quite complicated, right? It was only relatively recently we could even do it well with machines, right? You get a bunch of information processing happening in my retina and then it goes to the lateral nucleus, my thalamus, into the area V1, V2, V4, and the fusiform face area here that Nancy can wish her at MIT invented and blah, blah, blah, blah, blah. And I have no friggin' clue how that worked, right? It feels to me subjectively like my conscious module.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“In my lab, again, every time we look at how these large language models do something, we see that they do them in really dumb ways and you could make it better. Have loops in our computer language for a reason. The code would get way, way longer if you weren't allowed to use them. It's more efficient to have the loops. In order to have self reflection, whether it's conscious or not, even an operating system knows things about itself. You need to have loops already. So I think I'm waving my hands a lot, but I suspect that The most efficient way of implementing a given level of intelligence. Has loops in it, the self reflection and will be conscious.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“So that when you try to make things more efficient, which will naturally be a pressure to do, they become conscious. I'm kind of hoping that that's correct. And do you want me to give you a hand-wavy argument for it?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I have some questions about consciousness, about the nature of reality. I would just really, really love to understand also. I can tell you one, for example, that I've been obsessing about a lot recently. So I believe that As opposed to Noni is right, suppose there are some information processing systems that are conscious and some that are not. Suppose you can even make reasonably smart things like GPT-4 that are not conscious, but you can also make them conscious Here's the question that keeps me making light. Is it the case that the unconscious zombie systems that are really intelligent are also really efficient? So they're really inefficient?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Cool with that. So I can't waffle my way out of this question. It's a fair one. I think given that I'm a really, really curious person, that's really the defining part of who I am, I'm so curious. I have some physics questions. I loved to understand.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm not afraid of the truth. I'm very humble. I know I'm just a meat guy with all these flaws. But I... We talked a lot about homo sentience. I've already tried that for a long time with myself. That is what's really valuable about being alive to me is that I have these meaningful experiences. It's not good at this or good at that or whatever. There's so much I suck at”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Yes. And to not sound so we don't sound like, what's the Kumbaya tree huggers here, right? Not just saying love and peace, man, we're trying to actually help people understand the true facts about the other side. and feel the compassion. The truth makes you more compassionate, right? So that's why I really like using AI for truth-seeking technologies. That can, as a result, you know, get us more love than hate. And even if you can't get love, settle for some understanding, which already gives compassion. If someone is like, you know, I really disagree with you. But I can see why you're coming from. You're not a bad person who needs to be destroyed. But I disagree with you, and I'm happy to have an argument about it. That's a lot of progress compared to where we are 2023 in the public space, wouldn't you say?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Have you seen the movie Needful Things? It's a Stephen King novel. I love Stephen King and Max Fonsidov, Swedish actors thing, the guys. It's brilliant. I just thought I hadn't thought about that until now, but that's the closest I've seen to a movie about Moloch. I don't want to spoil the film for anyone who wants to watch it, but basically it's about this guy who turns out that you can interpret him as the devil or whatever, but he doesn't actually ever go around and kill people or torture people with burning coal or anything. He makes everybody fight each other. It makes everybody hate, fear each other, hate each other, and then kill each other. So that's the movie about Moloch”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Exactly. And it applies to some of the things that people have gotten most upset with capitalism for also, right, where everybody was just kind of trapped. Not to see if some company does something. Causes a lot of harm, and not that the CEO is a bad person, but she or he knew that all the other companies were doing this too. So Moloch is... A formable foe. I hope someone would make good movies so we can see who the real enemy is so we're not fighting against each other. Moloch makes us fight against each other. That's what Moloch superpower is The hope here is any kind of technology or the mechanism that lets us instead realize We're finding the wrong enemy.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Probably brings out the worst in people also when people are desperate like this. So some people have heard some people say that That's what's going to happen. They'd rather be at round zero and just get vaporized But I think people underestimate the risk of this because they aren't afraid of Moloch. They think, oh, because humans don't want this, so it's not going to happen. That's the whole point of Moloch, that things happen that nobody wanted.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Not understanding very much just like how bad this is. Most people, especially a lot of people in decision-making positions, still think of nuclear weapons as something that makes you powerful. Scary, powerful. They don't think of it as something where, yeah, just. Within a percent or two, you know, we're all just gonna starve to death”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“If it drops below freezing, pretty much almost most days in July, and then that's not good. So they worked out, they put this into their farming models. And what they found was really interesting. The countries that get the most hard hit are the ones in the northern hemisphere. So in the US and one model they had, they had about 99% of all Americans starving to death in Russia and China and Europe. Also about 99%, 98% starving to death. So, you might be like, oh, it's kind of poetic justice that both the Russians and the Americans. 99% of them have to pay for it because it was their bombs that did it. But that doesn't particularly cheer people up in Sweden or other random countries that have nothing to do with it, right? I think it hasn't entered the mainstream.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“The rampaging mobs foraging your food. No, it's the fact that you get so much smoke coming up from the burning cities into the stratosphere that... Spreads around the Earth from the jet streams in typical models, you get like 10 years or so where it's just crazy cold. During the first year after the war and their models, the temperature drops in Nebraska and in the Ukraine bread baskets, you know, like. Celsius or so, if I remember, no, yeah, 20, 30 Celsius, depending on where you are, 40 Celsius in some places, which is 40 Fahrenheit, 80 Fahrenheit colder than what it would normally be. So, you know, I'm not good at farming. But if it's snowing...”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Difficult to see an ending a quick peaceful ending to this tragedy that doesn't involve some horrible escalation, but also that we understand more clearly now just how horrible it was. There was an amazing paper that was published in Nature Food this August. by some of the top researchers who've been studying nuclear winter for a long time. And what they basically did was they combined climate models with agricultural models. So instead of just saying, yeah, you know, it gets really cold, blah, blah, blah. They figured out actually how many people would die in the different countries. And it's pretty mind blowing. So basically, what happens is the thing that kills the most people is not the explosions, it's not the radioactivity, it's not the EMP mayhem, it's not the...”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“So, this to me is a typical example of Moloch. You have these incentives of the two parties. Where both of them are just driven to escalate more and more, right? If Russia starts losing in the conventional warfare, the only thing they can do, since they're backed against the war, is to keep escalating. And the West has put itself in the situation now we've sort of already committed the dry rush out, so the only option the West has is to call Russia's bluff and keep sending in more weapons. This really bothers me because Moloch can sometimes drive competing parties to do something which is ultimately just really bad for both of them. What makes me even more worried is not just that I”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“And on the other hand, you have Russia who has, and you have the Russian leadership who knows that if they get completely driven out of Ukraine, you know. It's not just going to be very humiliating for them, but they might, it often happens when countries lose wars that things don't go so well for their leadership either. Like, do you remember when Argentina invaded the Falkland Islands? The military junta that ordered that, right? People are cheering on the streets at first when they took it. And then when they got their butt kicked by the British, you know what happened to those guys? We were out. And I believe those were still alive or in jail now, right? So the Russian leadership is entirely cornered where they know that Just getting driven out of Ukraine is not an option.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“It's our old friend Moloch again. It's really scary to see it where America doesn't want there to be a nuclear war. Russia doesn't want there to be a global nuclear war either. We both know that it would just be another if we just try to do it, both sides try to launch first. It's just another suicide race, right? So why is it the way you said that this is the closest we've come since 1962? In fact, I think we've come closer now than even the Cuban missile crisis. It's because of Moloch. You have these other forces. On one hand, you have the West. Saying that we have to drive Russia out of Ukraine. It's a matter of pride. We've staked so much on it that it would be seen as a huge Loss of the credibility of the West if we don't drive Russia out entirely of the Ukraine.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah. And if that next one isn't AGI, maybe the next one will. And there are many companies trying to do these things. The basic architecture of them is not some sort of super well-kept secret. So this is a time to, a lot of people have said for many years that there will come a time when they want to pause a little bit. That time is”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Honestly Past decade, I've deliberately given very long timelines just because I didn't want to fuel some kind of stupid Moloc race. But I think that cat has really left the bag now. I think it might be very, very close. I don't think that Microsoft paper is totally off when they say that there are some glimmers of AGI. It's not AGI yet. It's not an agent. There's a lot of things it can't do. Wouldn't bet very strongly against it happening very soon. That's why we decided to do this open letter because if there's ever been a time to pause. It's today.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Something like that, she would probably want it to be conscious, right? So the emotions it seems to display aren't fake. All these things can be Done in a good way if we give ourselves a little bit of time and don't run and Take on this challenge.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“And we do the same thing with cruelty to farm animals, also all these self-derving arguments for why they're fine. So we should certainly be watchful. I think step one is just be humble and acknowledge that consciousness is not the same thing as intelligence. And I believe that consciousness still is a form of information processing where it's really being aware of itself in a certain way. And let's study it and give ourselves a little bit of time. And I think we will be able to figure out actually what it is that causes consciousness and then we can make probably unconscious robots that do the boring jobs that we would feel are immoral to give the machines. But if you have a companion robot taking care of your mom.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Was horrified as a kid when someone started boiling lobsters. Like, oh my God, that's so cruel. And some grown-up there back in Sweden said, oh, it doesn't feel pain. I'm like, how do you know that? Oh, scientists have shown that. And then there was a recent study where they showed that lobsters actually do feel pain when you boil them. So they banned lobster boiling in Switzerland now. Presuming scientific research boiled down to someone asked the lobster as a start.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Obviously, not true. You can have a lot of conscious experience when you're not really accomplishing any goals at all. You're just reflecting on something. And you can sometimes... Have things doing things that are quite intelligent probably without being conscious.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Not in the sense of Hollywood, but in the sense of these one way direction neural networks. So they're all the zombies. That's the ultimate zombie apocalypse now. We have this universe that goes on with great construction projects and stuff, but there's no one experiencing anything. That would be like the ultimate depressing future. So I actually think... We move forward towards building more advanced AI, we should do more research on figuring out what kind of information processing actually has experience, because I think that's what it's all about. And I completely don't buy the dismissal that some people will say, well, this is all bullshit because consciousness equals intelligence.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Both a relief in that you don't have if it's true, in that you don't have to feel guilty about turning off GPT-4 and wiping its memory whenever a new user comes along. I wouldn't like if someone said that to me neuralized me like in men in black. But it's Creepy that you can have very high intelligence perhaps then that's not conscious because if we get replaced by machines Is it sad enough that humanity isn't here anymore? Because I kind of like humanity. But at least if the machines were conscious, they could be like, well, but they are descendants, and maybe they have our values and there are children. But if Tanoni is right, and it's all, these are all. Transformers that are”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“You can go around and round in computer science nerd speak, you call it a recurrent neural network where some of the output gets fed back in again. And with his. Mathematical formalism, if it's a feed forward neural network where information only goes in one direction, like from your eye, retina to the back of your brain, for example, that's not conscious. So he would predict that your retina itself isn't conscious of anything. A video camera. Now, the interesting thing about GPT 4 is it's also one way flow of information. So if Tanoni is right, GPT-4 is a very intelligent zombie that can do all this smart stuff but isn't experiencing anything. And”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“But if people hate the, yeah. So is GPT 4 conscious? Does GPT-4 have subjective experience? Short answer, I don't know because we still don't know what it is that gives this wonderful subjective experience that is kind of the meaning of our life, right? Because meaning itself, the feeling of meaning is a subjective experience. Joy is a subjective experience. Love is a subjective experience. Don't know what it is. I've written some papers about this. A lot of people have. Giulio Tinoni, professor Stuck his neck out the farthest and written down actually a very bold mathematical. Conjecture for what's the essence of conscious information processing. He might be wrong. He might be right, but we should test it. He postulates that consciousness has to do with loops in the information processing. Our brain has loops.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“I love this question. So let's define consciousness first because, in my experience, like 90% of all arguments about consciousness boil out to the two people arguing having totally different definitions of what it is and they're just shouting past each other. I define consciousness Subjective experience Right now, I'm experiencing colors and sounds and emotions, but does a self-driving car experience anything? That's the question about whether it's conscious or not, right? Other people think you should define consciousness differently fine by me, but then maybe use a different word for it. Or I'm going to use consciousness for this at least.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Philosophy seminar. And, like, I mean, I'm an educator myself, so it pains me to see this, but I feel our education right now is the completely obsolete by what's happening. You put a kid into first grade. And then they're going to come out of high school 12 years later And you've already pre-planned now what they're going to learn when you're not even sure if there's going to be any world left to come out to. Clearly, you need to have a much more opportunistic education system that keeps adapting itself very rapidly as society reads. The skills that were really useful when the curriculum was written, I mean, how many of those skills are going to get you a job in 12 years? I mean, seriously.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“It's an English professors, some English teachers are beginning to really freak out now. They give an essay assignment and they get back all this fantastic pros like, this is the style of Hemingway. And then they realize they have to completely rethink. And even, you know, Just like we stopped teaching. Writing a script, is that what you say in English?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Journalists divorce his wife. It was not because the engineers who built it was like, let's put this in here and screw a little bit with people. Hadn't predicted at all. They built the giant black box. Trained to predict the next word and got all these emergent properties. And oops, it did this, you know. I think this is a very powerful makeup, Colin. Anyone watching this who's not scared, I would encourage them to just play a bit more with these tools. They're out there now, like GPD4. Wake up call is first step once you've broken up, then got to slow down a little bit the risky stuff. To give a chance to all everyone who's woken up to catch up on the safety front.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“The skill of the prompt. No, exactly. There should be, at least just like every university worth its name has some cancer research going on in its biology department, right? Every university that does computer science should have a real effort in this area. And it's nowhere near that. This is something I hope is changing now thanks to GPT-4. If there's a silver lining to what's happening here, even though I think many people would wish it would have been rolled out more carefully, is that this might be the wake-up call that humanity needed to really Stop fantasizing about this being 100 years off and stop fantasizing about this being completely controllable and predictable because It's so obvious it's not predictable. Why is it that I think it was ChatGPT that tried to persuade...”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“What's nice about this is it's not just philosophical mumbo jumbo, it's theorems and technical work with more time, I think you can make a lot of progress. And there are a lot of brilliant people now working on AI safety. We just need to give them a bit more time.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Professor Stuart Russell at Berkeley, who is also one of the Driving forces behind this letter. A whole research program about this Think of it as AI humility, exactly, although he calls it inverse reinforcement learning and other nerdy terms. But it's about exactly that. Instead of telling the AI here's this goal, go optimize the bejesus out of it. Tell it okay Do what I want you to do, but I'm not going to tell you right now what it is I want you to do. You need to figure it out. So then you give the incentive to be very humble and keep asking you questions along the way. Is this what you really meant? Is this what you wanted? And oh, this is the other thing I tried didn't work seemed like it didn't work out right should I try it differently.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Oh, It's also the most worthy problem, the most important problem for humanity to ever solve. Because if we solve that one, Lex, That aligned AI can help us solve all the other problems.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“He was hoping that humanity was going to take this threat more seriously so we would have more time. And now I don't have more time. That's why the open letter is calling for more time.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Keep improving. So, these are a lot of hard challenges we're up for, but I don't think any of them are insurmountable. Fundamental reason why Elijah looked so depressed when I last saw him was because he felt it just wasn't enough time.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“First of all, understand our goals and then adopt our goals and then retain them as they get smarter, right? Three of those are really hard, right? Human child, first they're just not smart enough to understand our goals. They can't even talk And then eventually they're teenagers and then understand our goal just fine, but they don't share. But there's fortunately a magic phase in the middle where they're smart enough to understand our goals and malleable enough that we can hopefully with good parenting teach them right from wrong and instead good goals instill good goals in them. So, those are all tough challenges with computers. And then even if you teach your kids good goals when they're little, they might outgrow them too. And that's a challenge for machines.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“If that's the only goal it has, we are just sort of accidental roadkill along the way. And you could totally imagine, yeah, maybe this oxygen is kind of annoying because it causes more corrosion. So let's get rid of the oxygen. And good luck surviving after that. I'm not particularly concerned that they would want to kill us just because... That would be a goal in itself. We've driven a number of the elephant species extinct, right? It wasn't because we didn't like elephants. The basic problem is you just don't want to give control over your planet to some other more intelligent entity that doesn't share your goals. It's that simple. Which brings us to another key challenge, which AI safety researchers have been grappling with for a long time. How do you make AI?”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Usually, we didn't do it even systematically by going around one-on-one after the other and stepping on them or shooting them or anything like that. We just chopped down their habitat because we needed it for something else. In some cases, we did it by putting more carbon dioxide in the atmosphere because of some reason that those animals didn't even understand. And now they're gone, right? So if you're in AI and you just want to figure something out, then you decide we just really need this space here to build more compute facilities.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Carry concern for it, not that all humans are going to get killed by slaughterbots, but rather just an express route into Orwellian dystopia, where it becomes much easier for very few to kill very many and therefore becomes very easy for very few to dominate very many, right? If you want to know how AI could kill all people, just ask yourself, we humans have driven a lot of species extinct. How do we do it? We were smarter than them.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“Watch now this coming year. Microsoft is rolling out the new office suite where you go into Microsoft Word and give it a prompt. And it writes the whole text for you. And then you edit it. And then you're like, oh, give me a PowerPoint version of this. And it makes it. And now take the spreadsheet and da-a. And all of those things, I think, are you can debate the economic impact of it and whether society is prepared to deal with this disruption. But those are not the things which... That's not the elephant of the room that keeps me awake at night for wiping out humanity. I think that's the biggest misunderstanding we have. A lot of people think that we're scared of automatic spreadsheets. That's not the case. That's not what Eliezer was freaked out about either.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source
“And before we know it, we have something else which is not at all a large language model that looks nothing like it, but which is way more intelligent and capable and has goals. And that's the elephant in the room. And obviously, no matter how hard any of these companies have tried, that's not something that's easy for them to verify with a large language models. And the only way to be really lower that risk a lot would be to not let, for example, never let it read any code, not train on that, and not put it into an API and not give it access so much information about how to manipulate humans. But that doesn't mean you still can't make a lot. Ton of money on them, you know, we're gonna.”
2023-04-13 · Lex Fridman Podcast · #371 – Max Tegmark: The Case for Halting AI Development · IDENTIFIED FROM THE TRANSCRIPT · source