YouSaid · the spoken record

Eliezer Yudkowsky

lines on the record: 301
first: 2023-04-06
most recent: 2023-04-06
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“Your DNA modifier. There's an established preference for, I think, for people going to some lengths to make their kids healthier, not necessarily via the options that they would have later, but the options that they do have now.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, there's somewhat less. Oh, oh, no, sorry. Why not jump on this one? So, what you're saying is that as soon as the calendar turns 2024, itself a great speculation, I note. People will stop wanting to have kids and stop wanting to eat and stop wanting social status and power because human motivations are just not that stable and predictable.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“I think in that case we should believe that the dates and the calendars will never show 2024. Every single year throughout human history in the 13.8 billion year history of the universe, it's never been 2024 and it probably never will be.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I think that works better when the things you're breeding are stupider than you. As opposed to when they are smarter than you is my concern there”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Okay, so first of all, even if you have something that desires no power for its own sake if it desires anything else, it needs power to get there, not at the expense of the things it pursues, but just because you get more of whatever it is you want as you have more power and sufficiently smart things know that. It's not some weird fact about the cognitive system, it's a fact about the environment, about the structure of reality, and like the paths of time through the environment, that if you have, you know, in the limiting case, if you have no ability to do anything, you will probably not get very much of what you want.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Natural selection regularizes so much harder than gradient descent in that way. It's got an enormously stronger information bottleneck. Putting the L2 norm on a bunch of weights has nothing on the tiny amounts of information that can make its way into the genome per generation. The regularizers on natural selection are enormously stronger.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Really, the RLHF stuff. You don't think that there's nothing to be gained from manipulating humans into giving you a thumbs up?”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Sure, lots of instrumental values got made our way into our. But even more so than the current warped versions of them make their way into our intrinsic...”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“So, are they now? No, no, no. Not now. Nobody's been careful and deliberate now. But maybe at some point in the indefinite future people would be careful and deliberate. Sure. Let's grant that premise. Keep going.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Weird is relative to intelligence. The smarter you are, the more you can like move around in the space of abstractions and not have things seem so unfamiliar yet.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“But you yourself say, Oh, yeah, sure, I would choose that. And I myself say, oh, yeah, sure, I would choose that. And you think that there's some hypothetical other people would stubbornly stay attached to what you think is the wrong choice. Well, you know, then there's, you know, first of all, I think maybe you're being a bit condescending there. How am I supposed to argue with these imaginary foolish people who exist only inside your own mind, who can always be as stupid as you want them to be and who I can never argue? Because you'll always just be like, ah, you know, like they won't be persuaded by that. But right here in this room, the site of this videotaping, there is no counter evidence that smart enough humans will toss DNA out the window as soon as somebody makes them a sufficiently better offer.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“This is evidence for hope. Because we haven't yet had options as far enough outside of the ancestral distribution that in the course of choosing what we most want, that there's no DNA left.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Oh, what if I say, like, I have more faith than normal people than you do toss DNA out the window as soon as somebody offers them a happy, healthier life for their kids?”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“We haven't gone that smart. What you're saying is like, well, look, people are still making more of their DNA in a situation where nobody has offered them a way to get all the stuff they want without the DNA. So of course they haven't tossed DNA out the window.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Because they out of some sentimental, idealistic attachment using deoxyribose nucleic acid instead of the particular information encoding their cells as opposed to the new improved cells from alpha-fold 7.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“No, I'm saying that. The smart thing is kind of like a delicate issue here because somebody could always be like, I would never take that offer. And then I'm like, And it's not very polite to be like, I bet if we kept on increasing your intelligence, you would at some point at some point start to sound more attractive to you because your weirdness tolerance would go up as you became more rapidly capable of readapting your thoughts to weird stuff. And the weirdness starting to seem less unpleasant and more like you were moving within a space that you already understood. But you can sort of elide all that by, and we maybe should by being like, well, spill all your friends were doing it. What if it was normal? What if we remove the weirdness and remove any credibility problems in that hypothetical case? Do people choose for their kids to be dumber, sicker, less pretty?”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, because it would sound weird. But the smarter they are, I think the smarter they are, the more likely they are to go for it if it's credible. I also think that to some extent you're like, I mean, if you like, assume away the credibility issue and the weirdness issue. Like all their friends are doing it.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Alternate storage method that will age more slowly, they'll be healthier, they won't have to worry about DNA damage, they won't have to worry about the methylation on the DNA flipping and the cells de-differentiating as they get older. We've got this stuff that replaces DNA and your kid will still be similar to you. It'll be like a bit smarter and they'll be like so much healthier and even a bit more cheerful. You just have to rewrite all the DNA or like replace all the DNA with a stronger substrate and rewrite all the information on it. The old school transhumanist offer, really. And I think that a lot of the people who are like they would want kids would go for this new offer that just offers them so much more of what it is they want from kids than copying the DNA than inclusive genetic fitness.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“So, it's a question of how far out of distribution are you, and the smarter you are, the more out of distribution you get. Because as you get smarter, you get new options that are further from the options that you are faced with in the ancestral environment that you are optimized over. So in particular, sure, a lot of people want kids, not inclusive genetic fitness, but kids. They don't want their kids to want kids similar to them maybe, but they don't want the kids to have their DNA or their alleles, their genes. We will assume away the ridiculousness of this offer for the moment, incredibly say, you know, your kids could be a bit smarter and much healthier if you'll just let me replace their DNA with this all-”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Great, I claim humans are orthogonal to increasingly orthogonal, and the further they go out of distribution and the smarter they get, the more orthogonal they get. Two, inclusive genetic fitness, the sole loss function on which humans were optimized.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm confused. So look, you can always develop arbitrary fanciful scenarios in which the AI has some contrived motive that it can only possibly satisfy by keeping humans alive in good health and comfort and like turning all the nearby galaxies into happy, cheerful places full of high functioning galactic civilizations. But as soon as your sentence has more than like five words in it, its probability has dropped to basically zero because of all the extra details you're padding in.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“If the humans are no longer around, you no longer need to predict them. So, you don't need the data required to predict them”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Most drives that happen when you take a loss function and splinter it into things correlated with it, then amp up intelligence until some kind of strange coherence is born within the thing and then ask it how it want to self-modify or what kind of success or system it would build. Things that alien Ultimately, end up wanting the universe to be of some particular way that doesn't happen to have wanting the universe to be a way such that humans are not a solution to the question of how. Like the thing that very strongly wants to predict text, even if you got that goal into the system exactly, which is not what would happen. The universe with the most predictable text is not a universe that has the universe in it, the universe that has humans in it.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“This just seems 0% probable to me. Like the motive is going to be like, I want to, like, insofar the motive is going to be like some weird fun house mirror thing of I want to predict very accurately.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“That's very different from being the average. It's very different from being an average chess player versus being able to predict every chess player in the database. Are very different things”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“I think about how my thoughts are not good enough by my own standards and how I want to rearrange my own thought processes. I look at the world and see it going the way I did not want it to go and asking myself how could I change this world? I look around at other humans and I model them and sometimes I try to persuade them of things. These are all capabilities that the system would then be somewhere in there. And I just like Don't trust the blind hope that all of that capability is pointed entirely at pretending to be Eliasar and only exists in so far as it's like the mirror and isomorph of Eliasar, that all the prediction is by being something exactly like me and not thinking about me while not being me.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“So, like, if you ask me to play a part of somebody who is quite unlike me, I think there's some amount of penalty that the character I'm playing gets to his intelligence because I'm secretly back there simulating him. And that's even if we're quite similar and the stranger they are, the more unfamiliar the situation, the less the person I'm playing is as smart as I am, the more they are dumber than I am. So, similarly, I think that if you An AI that's very, very good at predicting what Eliaser says, I think that there's a quite alien mind doing that, and it actually has to be to some degree smarter than me. nor to play the role of something that thinks differently from how it does very, very accurately. I reflect on myself.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“and needing to be at least as smart as the human it is predicting in order to do that. I suspect at some point there is a new coherent sporn within the system and something strange starts happening. I think that if you have something that can accurately predict I mean, Ellie Azriudkowski to use a particular example I know quite well. I think that to accurately predict Eliasra Udkowski, you've got to be able to do the kind of thinking where you are reflecting on yourself and that in order to simulate Elias or Yudkowsky reflecting on himself. You need to be able to do that kind of thinking. This is not. Airtight logic? I expect there to be a discount factor”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“I think it predictably breaks down as you try to make the system smarter. As you try to drive into the Sufficiently useful work from it, and in particular like the sort of work where some other AI doesn't just kill you off six months later. I think the present system is not smart enough to have a deep conniving actress thinking long strings of coherent thoughts about how to predict the next word. But as the mask that it wears, as the people it's pretending to be gets smarter and smarter? I think that at some point the thing in there that is predicting how humans plan, predicting how humans talk, predicting how humans think”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“More likely, yes. Maybe you're like, it's an order of magnitude likelier, 0% instead of zero percent. Getting stuff like more likely does not help you if the baseline is like nearly zero. The whole training setup there is producing an actress, a predictor. It's not actually being put into the kind of ancestral situation that evolved humans, nor the kind of modern situation that raises humans, though to be clear, raising it like a human wouldn't help, but like, yeah, you're like giving it a very alien problem that is not what humans solve, and it is like solving that problem, not the way human would.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“You learn to switch rapidly from being one kind of person or another as the conversation that you are predicting changes who's speaking. This is not a human we're describing. You are not training a human there.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“This seems like an ordinate cope. For one thing, you're not training it to be any one particular person. You're training it to switch masks to anyone on the Internet. As soon as they figure out who that person on the Internet is put the internet in front of you and I was like learn to predict the next word, learn to predict the next word over and over, you do not just like turn into a random human because the random human is not what's best at predicting the next word of everyone who's ever been on the internet. You learn to very rapidly pick up on the cues of what sort of person is talking, what will they say next? You memorize so many facts that just because they're helpful in predicting that the next word, you learn all kinds of patterns.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Yes, because the religions are selected to not have that many apostates. If aliens came in and introduced their religion, you'd get a lot more apostates.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“And yeah, like, because they were trying to show me a way to be that was alien to my own psychology, and the religion that actually picked up was from the science fiction books instead, as it were, though I'm using religion very metaphorically here, more like ethos, you might say. I was raised with the science fiction books I was reading from my parents' library and Orthodox Judaism and the ethos of the science fiction books. Rang truer in my soul. And so that took in the Orthodox Judaism, didn't. But the Orthodox Judaism was what I had to imitate, was what I had to pretend to be. Was the answers I had to give, whether I believed them or not, because otherwise you get punished.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Depends on what you're telling them to be exactly. Yeah, but that's not what you're telling them to do. You're telling them to play the part of an alien. Something with a completely inhuman psychology, as extrapolated by science fiction authors, and in many cases done by computers because humans can't quite think that way. And your child eventually manages to learn to act that way. What exactly is going on in there now? Are they just the alien? Or did they pick up the rhythm of what you were asking them to imitate and be like, ah yes, I see who I'm supposed to pretend to be? Are they actually a person or are they pretending? That's true even if you're not asking them to be an alien. My parents tried to raise me Orthodox Jewish and that did not take at all. I learned to pretend. I learned to comply. I hated every minute of it. Okay, not literally every minute of it. I should avoid saying untrue things. I hated most minutes of it.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“I see, so like if you take a person and if you take an actor and tell them to play a character, they just become that person. You can tell that because you see somebody on screen playing Buffy the Vampire Slayer. And that's probably just actually buffing there. That's who that is.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Know it's the sort of thing where you could maybe do it, but there's all kinds of pitfalls that you'd probably find out about if you cracked open a textbook on animal breeding?”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Of selectively encouraging some marriages between particular people and encouraging them to have children, you will rapidly find, as one does in any process of this to, say, chickens, that when you select on the stuff you want, it turns out there's a bunch of stuff correlated with it and that you're not changing just one thing. If you try to make people who are inhumanly nice, who are nicer than anyone has ever been before, you're going outside the space that human psychology has previously evolved and adapted to deal with, and weird stuff will happen to those people. None of this is very analogous to AI. I'm just pointing out something along the lines of, well, taking your analogy at face value. What would happen exactly?”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“So, the main thing is that you're starting from minds that are already very, very similar to yours. You're starting from minds of which whom many of them already exhibit the characteristics that you want. There are already many people in the world, I hope, who are nice in the way that you want them to be nice. It's of course, it depends on how nice you want exactly. I think that if you like actually go star trying to run a”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Maybe the GPT four level systems can be reinforcement learning from human feedback into being consistently smart, nice, and charitable in conversation and just unleash a billing of them on Twitter and just have them spread sanity everywhere. I do not think this, I do worry that this is not going to be the most profitable use of the technology. But you're asking me to list out Hail Mary passes, so that's what I'm doing. Maybe you can actually figure out how to A brain, slice it, scan it, simulate it, run uploads and upgrade the uploads or run the uploads faster. These are also quite dangerous things, but they do not have the utter lethality of artificial intelligence.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“I mean, I think we're just mainly in the territory of Hale Mary passes at this point. And human intelligence enhancement is one hail Mary pass. Maybe you can put people in MRIs and Train them using neurofeedback to be a little saner, to not rationalize so much. Maybe you can figure out how to have something light up every time somebody is working backwards from what they want to be true to what they take as their premises. Maybe you can just fire off little lights and teach people not to do that so much.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“How do I put it? If you were on a sane planet with the sane planet does at this point is shut it all down and work on human intelligence enhancement. It is, I don't think we're going to live in that sane world. I think we are all going to die. But having heard that people are more open to this outside of California, it makes sense to me to just try saying out loud what it is that you do in a saner planet and not just assume that people are not going to do that.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, alignment will not be solved in a few years. I would hope for something along the lines of human intelligence enhancement works. I do not think we're going to have the timeline for Genetically engineering humans to work, but maybe this was why I mentioned the time letter that if I had infinite capability to dictate the laws that there would be a carve out on biology, like AI that is just for biology and not trained on text from the internet, human intelligence enhancement. Make people smarter. Making people smarter has a chance of going, right, in a way that making a extremely smart AI does not have a realistic chance of going right at this point. So, yeah, that would, in terms of like remotely...”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Systems would still get more capable over time as the algorithms improved and got more efficient, like more oomph per floating point operation. And things would still improve but slower. If you start that process off at the GPT-5 level, where I don't actually know how capable that is exactly, you may have like a bunch less lifeline left before you get into dangerous territory.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Rate at which these systems acquire capability as they are trained to larger and larger sizes and more and more tokens. And like GPT-4 is a bit beyond in some ways where I thought this paradigm was going to scale period. So I don't actually know what happens if GPT-5 is built. And even if GPT-5 doesn't end the world, which I agree is like more than 50% of where my probability mass lies, even if GPT-5 doesn't end the world, maybe it's maybe that's enough time for GPT 4.5 to get ensconced everywhere and in everything and for it actually to be harder to call a stop, both politically and technically. There's also the point that Training algorithms keep improving. If we put a hard limit on the total computes and training runs right now,”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“Because allegedly, possibly, and we will see, people right now are able to appreciate that things are storming ahead and a bit faster than the ability to, well, ensure any sort of good outcome for them. And, you know, you could be like, ah, yes, well, like we will play the Galaxy brain clever political move of trying to time when the popular support will be there. But again, I heard rumors that people were actually like completely open to the concept of let's stop. So again, just trying to say it. It's not clear to me what happens if we wait for GPT 5 to say it. I don't actually know what GPT-5 is going to be like. It has been very hard to call”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“And nobody is saying they are. Well, I'm not saying they are. The open letter signatories aren't saying they are. I don't think I.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“No, I'm going on reports that normal people Are more willing than the people I've been previously talking to entertain calls, this is a bad idea. Maybe you should just not do that.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“I think that I thought that this was something very unlikely for governments to adopt, and then all of my friends kept on telling me like, no, no, actually if you talk to anyone outside of the tech industry, they think maybe we shouldn't do that. And I was like, all right then. Like I assumed that this concept had no popular support. Maybe I assumed incorrectly. It seems foolish and to lack dignity to not even try to say what ought to be done. There wasn't a galaxy brain purpose behind it. I think that over the last 22 years or so, you've seen a great lack of galaxy-brained ideas playing out successfully.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source
“To rouse your planet There are the idiot disaster monkeys who are like O like if this is dangerous it must be powerful, right? I'm gonna be like be first to grab the poison banana and it's not a coincidence that I can like zoom in and poke at this and ask questions like this and that you did not ask these questions of yourself. You are imagining nice ways you can get the thing but reality is not necessarily imagining how to give you what you want Should one remain silent? Should one let everyone walk directly into the whirling gracerades? Like continuing to play out a video game you know you're going to lose that's all you have.”
2023-04-06 · Dwarkesh Podcast · Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality · IDENTIFIED FROM THE TRANSCRIPT · source