YouSaid · the spoken record

Wojciech Zaremba

lines on the record: 186
first: 2021-08-29
most recent: 2021-08-29
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“I mean, definitely there will be more impressive models. There is a question, of course, if there will be a phase shift. I'll say even the way I'm thinking about these models is that when we build these models, we see some level of the capabilities, but we don't even fully understand everything that the model can do. And actually, one of the best things to do is to allow other people to probe the model to even see what is possible”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, people who criticize GPT. They say, you are the guy Building a taller ladder. And it will never reach the moon. That moment, I would say the way I'm thinking is this is like a scientific question. And I'm also creator. And like I'm thinking, let's try out. Let's see how far it goes. And so far we see constantly that there is a progress.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So let's see, it seems that intelligence itself is there are multiple axes of it. And I would expect that The systems that we are building, they made end up being super human on some axis and subhuman on some other axis. It would be surprising to me on all axis simultaneously they would become superhuman. Of course people ask this question, is GPT a spaceship that Would take us to moon, or are we putting a ladder to heaven that we are just building bigger and bigger ladder? And we don't know in some sense which one of these two works”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Saddle at first, and in some sense Can also say that the data that is not out there is the data which would represent how the human learns. And maybe each model would be trained on such a data than it would be better off.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I think that actually what happens with humans is if you have a wrong belief about the world as a kid, then very quickly you'll learn that it's not correct because you are grounded in reality and you are learning from your new experience.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Okay, I don't know. I would say that Elon is my wife. The model will just keep on carrying it on Yes. And in some sense, if you would have a normal conversation with Ilan, he would be, what the fuck?”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, the model is trained on all the existing data that is out there, which means that it is not trained on its own mistakes. So, for instance, if it would make a mistake, then to give you an example. So let's say I have a conversation with a model pretending that it's Elon Musk. And then I start putting some, I start actually making up things which are not factual.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I mean, I also want to provide some caveats so it can generate few paragraphs of coherent text, but as you go to longer pieces, it actually goes off the rails. If you would try to write a book, it won't work out this way.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“This model can be used for way more sophisticated tasks. So you can format text such that it looks like a conversation between two people. And that might be a conversation between you and Elon Musk. And because the model read all the text about Elon Musk, it will be able to predict Elon Musk words as it would be Elon Musk. It will speak about colonization of Mars, about sustainable future and so on. And it's also possible to Even give arbitrary personality to the model. You can say, here is a conversation with a friendly AI bot. And the model will complete the text as a friendly AI bot.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Who is the president of the United States than GPT can give you an answer to it? It turns out that many more things can be formulated this way. You can format text in the way that you have sentence in English You make it even look like some content of a website elsewhere, which would be teaching people how to translate things between languages. So it would be en colon, text in English, Fron. And then you ask model to continue. And it turns out that such a model is predicting translation from English to French. The crazy thing is that”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So GPT 3 is a humongous neural network. Let's assume that we know what is neural network. The definition. And it is train on the entire internet just to predict next words. So let's say it sees part of the article and the only task that it has at hand is to say what would be the next word, what would be the next word. And it becomes really exceptional at the task of figuring out what's the next word. So you might ask, why would this be an important task? Why would it be important to predict what's the next word? And it turns out that a lot of problems can be formulated as a text completion problem. So GPT is purely learning to complete that text. You could imagine, for instance, if you are asking a question”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I think that the big piece has to do with actually even engineering your environment such that it's conducive to that. So see, both Ilya and I, on the frequent basis, we kind of disconnect ourselves from the world in order to be able to do extensive ammona thinking. Ilya usually he just leaves iPad at hand. He loves his iPad. And for me, I'm even sometimes just going for a few days to different location, to Airbnb. I'm turning off my phone and there is no access to me. And that's extremely important for me to be able to actually just formulate new thoughts to do deep work rather than to be reactive. And the older I am, the more of this random tasks are at hand.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“First, they read a lot of books and then they did thinking, and then they figure out math. And that's how it feels with Ilya. You know, at first he read stuff, and then he spent his thinking cycles and”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I mean, so even in the space of deep learning, when you look at various people, there are people who invented some breakthroughs once, but there are very few people who did it multiple times. And you can think if someone invented it once Might be just a sheer luck. And if someone invented it multiple times, you know, if a probability of inventing it once is one over a million. Then, probability of inventing it twice or three times would be one over a million square or to the power of three, which would be just impossible. So it literally means that it's given that it's not the luck. And Ilya is one of these few people who have a lot of these inventions in his arsenal. It also feels that, for instance, if you think about folks like Gauss or Euler”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Correct. Ultimately, for instance, let's say Ilya, he doesn't manage people. That's not what he likes or so. I like hanging out with people. By default, I'm an extrovert and I care about people”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“And I'm also not holding to people like I'm growing people and then people become managers at OpenAI. I grew many of them. A research manager.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I can say I also understood over the time where my strengths are obviously we have plenty of AI discussions. And you know, I myself have plenty of ideas, but I consider Ilya one of the most prolific AI centers in the entire world. And I think that I realized that maybe my super skill is being able to bring people to collaborate together, that I have some level of empathy that is unique in AI world. And that might come from either meditation, psychedelics, or let's say I read just hundreds of books on this topic. And I also went through a journey of, you know, I developed all sorts of algorithms. So I think that Maybe I can, that's my super human skill. Ilya is one of the best AI scientists, but then I'm pretty good in assembling teams.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So I believe that we have extreme respect to each other. So I love Ilya's insight, both, I guess, about consciousness, life, AI.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“My style is actually, I also sometimes take cold showers. It is purely observing how the water goes through my body, like a purely being present, not trying to escape from there. And I would say then it actually becomes pleasant. It's not like”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yes, you experience it, and then they teach you to observe it. And it's like the crazy thing is you at first might have a feeling toward trying to escape it. And that becomes very apparent that that's extremely unpleasant. And then you just observe it. And at some point, it just becomes. I remember that if Ilya told me some time ago that he takes a cold shower and his mindset of taking a cold cold shower was to embrace suffering”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, the thing is actually Literally just depends on your own framing. If you are in the mindset that you are waiting for it to be over or you are waiting for Nirvana to happen. Will be very unpleasant. In some sense, even the difficulty, it's not even in the Lack of being able to speak with others. You are sitting there, your legs will hurt from sitting.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Think that actually retreat is the way to go. It almost feels that, as I said, like meditation is a psychedelic, but when you take it in the small dose, you might barely feel it. Once you got the high dose, actually, you're gonna feel it.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“GPT. Yes, yes, and that's description of you. And then we've meditation, you can get to that point that actually you experience things without the prompt. And you experience things like as they are, you are not biased over the description how they're supposed to be, that's very pleasant. And then with respect to the reward function, it's possible to get to the point that there is dissolution of self and therefore you can say that you are having your brain attempts to simulate the reward function of everyone else or like everything. There is this like a love which feels like oneness with everything. That's also very beautiful, very pleasant at some point, you might have a lot of altruistic thoughts during that moment, and then that self always comes back”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Something similar how I'm thinking about this. So I told you that there is this story of who you are. And I think almost about it as a text prepended to GPT. And some people refer to it as ego. There's like a story who you are, okay?”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Corresponds to the subjective experience. Some people, I guess, in spiritual community, they describe it that that's the reality. And I would say I believe that they're like all sorts of subjective experience that one can have. And I believe that, for instance, meditation might take you to the subjective experiences, which are very pleasant collaborative. And I would like a word to move toward more collaborative place. I would say that's very pleasant, and I enjoy doing stuff like that.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, pretty much. I mean, still, there is a thoughts are slowing down. Sometimes they pop up, but it's also somehow the extended meditation takes you to the space that they are way more friendly. There is also this thing that we've almost feels that the It almost feels that we are constantly getting a little bit of a reward function and we are just spreading this reward function on various activities. But if you stay still for extended period of time, it kind of accumulates, accumulates, accumulates. And there is a sense, there is a sense that some point it passes some threshold and it feels us. Drop is falling into kind of ocean of love and bliss. And that's like a very pleasant. And that's why I'm saying like a”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Then once there is nothing left, the default state of human mind is extremely peaceful and happy. In some sense, it feels that the... Feels at least to me the way how when I was a child that I can look at any object and it's very beautiful I have a lot of curiosity about the simple things And that's where the usual meditation”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Sorry to keep in touch. Yeah, so it's optimized even though there are other people. It's optimized for isolation. So you don't speak with anyone. You don't actually look into other people's eyes. And you sit on that shirt. So you try to put all attention into breathing in and breathing out. And crazy thing is that as you focus attention like that, after some time, their stamps starts coming back like some memories that you're completely forgotten. It almost feels like that you have a mailbox and then you are just like an archiving email one by one. And at some point, there is an amazing feeling of getting to Mailbox Zero. Zero emails, and it's very pleasant. It's kind of crazy to me that once You resolve these inner stories or like an inner traumas.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I practice meditation. I mean, I once a few times on the retreats and it feels after second or third day of meditation. There is almost like a sense of tripping.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Extremely high resolution. And it's also kind of interesting to me that somehow there seems to be some similarity between These drugs and meditation itself. And I actually started even these days to think about meditation as a psychedelic.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So let's see. I don't believe in magic. I believe in science, in causality. Still, let's say, and as I said, I think that the brain Our subjective experience of reality is a We live in the simulation run by our brain, and the simulation that our brain runs, they can be very pleasant or very hellish. Drugs are changing some hyperparameters of the simulation. It is possible thanks to change of these hyperparameters to actually look back on your experience and even see that the given things that we took for granted, they are changeable. So they allow to have an amazing perspective. There is also, for instance, the fact that after DMT people can see the full movie inside of their head gives me further belief. Brain can generate that full movie that the brain is actually.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Would like to move to that place that actually we have scientific understanding what consciousness is. And then we'll be able to actually assign value. And I believe that there is even the path for the experimentation in it. We said that you could put the probes inside of the brain. There is actually few other things that you could do with devices like neural link. So you could imagine that the way even to measure if AI system is conscious is by literally just plugging into the brain. I mean that assumes that it's kind of easy. The plugin to the brain and asking person if they feel that their consciousness expanded. This direction, of course, has some issues. You can say, if someone takes a psychedelic drug, they might feel that their consciousness expanded, even though the drug itself is not conscious.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Think it requires empathy as well. I mean, I would like us or humanity or so mega progress in understanding what consciousness is because I don't want just to be speaking about it. There was a time that people thought that there is a force of life and the things that have this force, they are alive. And I think that there is actually a path to understand exactly what consciousness is. And in some sense, it might require essentially putting probes inside of a human brain. What neural link does.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“And we evolved to actually identify ourselves with larger groups. So we can identify ourselves with a family. We can identify ourselves with a country to such an extent that people are willing to give away their life for country. So we are wired actually even for love. And at the moment, I guess maybe it would be somewhat more beneficial if we would identify ourselves with all the humanity as a whole. So you can clearly see when people travel around the world, when they run into person from the same country, they say, oh, which CTR and all this, all of a sudden they find all these similarities, they find, they befriend those folks earlier than others. So there is some sense of the belonging. And I would say I think it would be overall good thing to the world for people to”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“It's not out of distribution. It's like, as you said, it evolved for cooperation And I believe that in some sense, cooperation ends up helping each of us individually. So it makes sense evolutionary. And there is, in some sense, and love means there is this dissolution of bandaries that you have a shared reward function.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So we came to existence as a consequence of evolutionary process. And in some sense, the purpose of evolution is survival. And then this complicated optimization objective baked into us, let's say, compression, which might help us operate in the real world. And it baked into us various reward functions. Then, to be clear, at the moment, we are operating in the regime, which is somewhat out of distribution where the event evolution optimized us.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“And accepting that they are there, like, you know, often people have a negative self talk, or they say, I don't like when I'm angry. Like a try to imagine a Try to imagine if there would be like a small baby legs, like a five years old Angry. And then they are like, you shouldn't be angry. Like, stop being angry. But instead, actually you want the legs to come over, give him a hug, and I say it's fine. You can be angry as long as you want.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“And I believe that the self love means that the love between all these personas, which also means being able to love yourself when we are angry or stressed or so.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I mean, you could imagine that if you are fully optimizing someone's reward function without yours, then. Then maybe are creating code dependency or something like that. That I'm not sure what's the appropriate way But the interesting thing is I even think that the individual person, we ourselves, we are actually less of a unified insight. So for instance, if you look at the donut on the one level, you might think, oh, this looks tasty. I would like to eat it. On another level, you might tell yourself, I shouldn't be doing it because I want to gain muscles. And you might do it regardless against yourself. So it seems that even within ourselves, they're almost like a kind of intertwined personas.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“In some sense, I would say love means helping others to optimize their reward functions, not your reward functions, not the things that you think are important, but the things that the person cares about, you try to help them to optimize it.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“It turns out that various people might be optimizing slightly different reward functions. They essentially might care about different things. And in case of Love, at least the love between two people, you can say that the boundary between people dissolves to such extent that they end up optimizing each other reward functions.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Very much agree. So I thought in the past about the somewhat similar question to yours, which is what is love rather what is connection? Obviously, I think about these things from AI perspective. What would it mean? So I said that the Intelligence has to do with some compression, which is more or less like I can say almost understanding of what is going around. It seems to me that another aspect is there seem to be reward functions and you can have reward for food, for maybe human connection, for let's say warmth sex and so on.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, I think connection has to do with understanding, and I think that almost like a lack of understanding causes suffering. If you speak with someone and you feel ignored, that actually causes pain. If you are feeling deeply understood, that actually they might not even tell you what to do in life Like a pure understanding”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Out the AGI endeavor is by default that's an endeavor to increase amount of wealth. And I believe that we can vastly increase amount of wealth for everyone. And simultaneously, I mean, these are like two endeavors that make sense to me. One is essentially increase amount of wealth. And second one is increase overall human well-being.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, I think that here that's a similar situation. I also wouldn't deploy the system in the high stakes situations right away, but kind of see gradually where it goes. And obviously initially it would have to go hand in hand with humans. At the moment, we are in the situation that actually there is many more people who actually would like to have a therapy or speak with someone than there are therapies out there. So fundamentally, I was thinking, what are the things that can vastly increase people's well-being? Therapy is one of them. I think meditation is other one. I guess maybe human connection is the third one. And I guess pharmacologically it's also possible, maybe direct brain stimulation or something like that, but these are pretty much options out there. Let's say the way I'm thinking”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Actually, so I think that reading a huge number of transcripts is a step one. It's like the same way as you cannot learn to dance if just from YouTube by watching it, you have to actually try it out yourself.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I think there is something in the data. Yes, I mean, there are plenty of transcripts of conversations, and it is possible to understand personalities. It is possible from it to understand if conversation is friendly, amicable antagonistic. I believe that given the fact that the models that we train now, they can They can have they are chameleons that they can have any personality, they might turn out to be better in understanding personality of other people than anyone else.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So let's see. So to be clear, I don't think that the current models are good enough for such a task because it requires insane amount of understanding empathy. And the models are far from this place, but”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Vastly decreased sample complexity, I believe so. But the place where we are heading today is there are domains which contain million x more data. And even though computers might be 1000 times slower than humans in learning, that's not the problem. For instance, I believe that it should be possible to create superhuman therapists. And they're like even simple steps of doing it. And the core reason is there is just machine will be able to read way more transcripts of therapies and then it should be able to speak simultaneously with many more people and it should be possible to Optimize it all in parallel”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“That's true as well. So, I mean, they're like a few pieces. So, one piece is human brain is an incredible supercomputer. And they're like a It has 100 trillion parameters Like if you try to count various quantities in the brain, there are like a neuron synapses. There are small number of neurons. There is a lot of synapses. It's unclear even how to map synapses to parameters of neural networks, but it's clear that there are many more. So it might be the case that our networks are still somewhat small. It also might be the case that they are more efficient than brain or less efficient by some huge factor. I also believe that there will be, you know, at the moment we are at the stage that these neural networks, they require 1000x or like a huge factor of more data than humans do. And it will be a matter of there will be algorithms that”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source