YouSaid · the spoken record

Wojciech Zaremba

lines on the record: 186
first: 2021-08-29
most recent: 2021-08-29
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“Could solve complicated problems, so they were in search for the other algorithms. And as I'm saying, I believe that actually we are in the game where there are actually, frankly, three levers. There is compute. There are algorithms and there is data. And if we want to build intelligent systems, we have to pull all three levers. And they are actually multiplicative. It's also interesting, so you ask, is it only compute? People internally, they did the studies to determine how much gains they were coming from different levers. And so far, we have seen that more gains came from computer algorithms. But also we are in the world that in case of compute, there is a kind of exponential increase in funding. And at some point, it's impossible to invest more. It's impossible to invest $10 trillion, as we are speaking about the, let's say,”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“The interesting thing is these algorithms were invented decades ago and people actually gave up on the idea. And back then they thought that we need profoundly different algorithms and they spent a lot of cycles on very different algorithms. And I believe that we have seen that various innovations that say like Transformer or Dropout or so they can pass the help. But it's also remarkable to me that this algorithm from 60s or so, or I mean, you can even say that the gradient descent was invented by Leibniz in, I guess, 18th century or so that actually is the core of learning. In the past, people are, it's almost like an out of the maybe an ego. People are saying that it cannot be the case that such a simple algorithm is the, you know.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I mean, I'm thinking about the trick, but it's still amusing to me that it works at all. Let's say that the extremely simple algorithm stochastic gradient descent, which is something that I would be able to derive on the piece of paper to high school student when put at the scale of thousands of machines actually can create the behaviors which we called kind of human-like behaviors.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Thank you for giving definition. I'm supposed to do it, but I guess you have enough empathy to listeners to actually know that that might be useful.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I mean, the nice thing about the neural networks is that it allows the things to be more fuzzy than in case of programs you have this like a branching this way or that way and neural networks they have an easier way to be somewhere in between or to share things”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So there is a work by Christopher Ollach where he works on interpretability of neural networks and he was able to identify inside of the neural network, for instance, a detector of a wheel for a car or the detector of a mask for a car. And then he was able to separate them out and assemble them together using a simple program for the detector, for a car detector.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“The thing that I hinted just a second ago is maybe that closest to how I'm thinking these days about deep learning. So the statement is neural networks can represent some programs. It seems that various modules that we are actually adding up to, like we want networks to be deep because we want multiple steps of the computation. And deep learning provides a way to represent space of programs, which is searchable. And it's searchable with stochastic gradient descent. So we have an algorithm to search over humongous number of programs and gradient descent kind of bubbles up the things that tend to give correct answers.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So you could imagine if there would be tremendous amount of if statements. Then they wouldn't be that short in case of neural networks. You could imagine that what happens is when you start with uninitialized neural network, it stores internally many possibilities how the problem can be solved. And SGD is kind of magnifying some paths which are slightly similar to the correct answer. So it's kind of magnifying correct programs and in some sense HDD is the search algorithm in the program space and the program space is represented by kind of the wiring inside of the neural network. And there's like an insane number of ways how the features can be computed.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So they said the things have to agree with NBITs. So even if you need to store, if you have very short program and they're like, if it's not perfect with prediction of n bits, you have to store errors. What are the errors? And that gives you the full program that agrees on n bits.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“It's a formalization of it. It also means, like, if you would ask the question after how many years would sun explode. You can say it's more likely the answer is due to some power because it's a shorter program.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Every possible program that generates these n bits. And you can choose programming language. It can be in Python or C++. And the difference between programming languages might be there is a difference by constant asymptotically your predictions will be equivalent. So you read and beats, you enumerate all the programs that produce these NBs in their output. And then in order to predict N plus 1 bit, you actually weight the programs according to their length. And there is some specific formula how you weigh them. And then the N plus 1 bit prediction is the prediction from each of this program according to the weight.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, first of all, the task itself is described as you have infinite sequence of zeros and ones. You read n bits and you are about to predict n plus one bit. So that's the task. And you could imagine that every task could be casted as such a task. So if, for instance, you have images and labels, you can just turn every image into a sequence of zeros and ones. Then label you concatenate labels and that's actually the and you could you could start by having training data first and then afterwards you have test data so theoretically any problem could be casted as a problem of predicting zeros and ones on this infinite tape so so let's say you read already n bits and you want to predict n plus one bit and i will ask you to write f”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, so he developed the framework even to describe what's optimal with respect to reinforcement learning. Like there is a theoretical framework, which is as you said under assumption there is infinite amount of memory and compute. There was actually one person before his name is Solomonov who extended Solomonov work to reinforcement learning, but there exists theoretical algorithm which is optimal algorithm to build intelligence and i can actually explain you the algorithm”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“That makes sense so you can make perfect compression if you store errors. And I think that actually what he meant is you have algorithm plus errors. By the way, Hutter was a PhD advisor of Shen Lek, who is a deep mind co-founder.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So it's a specific computation, and I said this computation has to do with compression. And the compression itself may be other way of putting it is like you are internally creating the model of reality in order to try inside to simplify reality in order to predict what's going to happen. And that also feels somewhat similar to how I think actually about my own conscious experience. So clearly I don't have access to reality. The only access to reality is through cable going to my brain. And my brain is creating a simulation of reality and I have access to the simulation of reality.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“That could have to do with consciousness. And then I thought you see in mathematics, there is something called Gadelt theorem, which means you have, if you have sufficiently complicated mathematical system, it is possible to point the mathematical system back on itself. In computer sense, there is something called Halting problem. It's somewhat similar construction. So I thought that, you know, if we believe that under assumption that consciousness has to do with compression, then you could imagine that ACR keep on compressing things, then at some point it actually makes sense for the compressor to compress itself.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“We think about the models AI models, what they truly try to do, or like models like GPT is They try to predict next word or so. And this turns out to be equivalent to compressing text. And because in some sense compression means that you learn the model of reality and you have just to remember where are your mistakes, the better you are in predicting the. And in some sense, when we look at our experience, also when you look, for instance, the car driving, you know in which direction it will go. You are good like in prediction. And it might be the case that the consciousness is intertwined with compression. It might be also the case that self-consciousness has to do with compressor trying to compress itself. So, okay, I was just wondering what are the objects in mathematics or computer science which are mysterious that could”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So it seems clear to me that not every computation is conscious. I mean, you can, let's say, just keep on multiplying one matrix over and over again and maybe gigantic matrix, you can put a lot of computation. I don't think it would be conscious. So in some sense, the question is, what are the computations which could be conscious? I mean, so one assumption is that it has to do purely with computation that you can abstract away matter. Other possibilities, it's very important was the realization of computation that it has to do with some force fields or so, and they bring consciousness. At the moment, my intuition is that it can be fully abstracted away. So in case of computation, you can ask yourself, what are the mathematical objects or so that could bring such properties? So for instance,”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, GPT itself is multimodal. GPT itself hasn't learned actually from experience of single human, but from the experience of humanity. It's a chameleon. You can turn it into anything. And in some sense, by providing context, it behaves as the thing that you wanted it to be. It's interesting that people have stories of who they are. And as I said, these stories, they help them to operate in the world. But it's also interesting because various people find it out through meditation or so that there might be some patterns that you have learned when you were a kid that actually are not serving you anymore. And you also might be thinking that that's who you are and that's actually just a story.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So I will just refer maybe to the first part as you said about the kind of story of describing who you are. Was thinking about it even so, you know, obviously I like thinking about consciousness. I like thinking about AI as well. And I'm trying to see analogies of these things in AI. What would it correspond to? Open AI trained. Model called GPT, which can generate pretty amusing text on arbitrary topic. And one way to control GPD is by putting into prefix at the beginning of the text some information what would be the story about. You can have even chat with GPT by saying that the chat is with legs or Elon Musk or so and GPT would just pretend to be you or Elon Musk or so. And it almost feels that this story that we give ourselves to describe our life, it's almost like things that you put into context of GPT.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“The crazy thing, so let's say, I mean, in meditation, they teach people not to speak story inside of the head. There is also some fraction of population who doesn't have actually narrator. I know people who don't have a narrator, and they have to use external people in order to kind of solve tasks that require internal narrator. It seems that it's possible to have the experience without the talk.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“It feels, it might be also somewhat related to memory and recurrent connections. So it's kind of, if you look at anesthetic drugs, they might be disturb brain waves such that Maybe memory is not”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“At data agents, they collaborate together and they have some anticipation of if they would win battle, they have some expectations with respect to other agents. I might be too much anthropomorphizing how the things look for me. But then the fact that they have a symbol for other agents makes me believe that at some stage as the you know, as they are optimizing for skills, they would have also symbol to describe themselves. This is like a very useful symbol to have. This particularity I would call it like a self-consciousness or self-awareness. And still it might be different from the consciousness. So I guess the way how I'm understanding the word consciousness, I'd say the experience of drinking a coffee or let's say. Experience of being a but that's the meaning of the word consciousness it doesn't mean to be awake”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“From a background over the time, it kind of knows where there is a foot and it just follows it. Over the time it actually starts having a 3D perception. So it is possible, for instance, to look inside of the head of an agent and ask what would it see if it looks to the right. And the crazy thing is, you know, initially when the agents are barely trained that these predictions are pretty bad, over the time they become better and better, you can still see that if you ask what happens when the head is turned by 360 degrees for some time they think that the different thing appears and then at some stage they understand actually that the same thing is supposed to appear. So they get an understanding of 3D structure. It's also very likely that they have inside some level of like a symbolic reasoning like particularly symbols for other agents. So when you look”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“From perspective of intelligence and consciousness, my current intuition is that they might be quite intertwined. First of all, it might not be that it's like a binary thing that you have intelligence or consciousness. It seems to be more continuous component. Let's see. If we look, for instance, on the even networks recognizing images, people are able to show that the activations of these networks correlate very strongly with activations in visual cortex of some monkeys. The same seems to be true about language models. Also, if you, for instance, if you train agent in 3D word, at first it barely recognizes what is going on over the time it kind of recognizes for granted.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So let me at first explain you my kind of mental model, what I think is needed for life to appear. So I imagine that at some point there was this primordial zoop of amino acids and maybe some proteins in the ocean. And some proteins were turning into some other proteins through reaction. And you can almost think about this cycle of what turns into what as there is a graph essentially describing which substance turns into some other substance. And essentially life means that all of a sudden in the graph has been created a cycle such that the same thing keeps on happening over and over again. That's what is needed for life to happen. And in some sense you can think almost that you have this gigantic graph and it needs like a sufficient number of edges for the cycle to appear then”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I mean, still, it is hard for me to actually understand how the politics works or how this exactly how the things would play out. Sam is a really excellent”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm thinking from time to time about these topics, but it also feels to me that it's a little bit like it's hard for me to actually make correct predictions what is the appropriate thing to do. I extremely trust Sam Altman, our CEO on these topics. I'm more on the side of being, I guess, naive hippie that...”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Wished, or like that's, I guess, purpose of politics to align the incentive systems. And we are kind of maybe even moving in this direction. The first issue is even to be able to measure the things that we value. Then we can actually assign the monetary value to them.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So let's see. I was wondering why actually even we have negative impact on the globe because if you ask every single individual, they would like to have clean air. They would like healthy planet, but somehow it actually is not the case that as a collective we are not going in this direction. Think that there exists very powerful system to describe what we value, that's capitalism, it assigns actually monetary values to various activities. At the moment, the problem There is no cost assigned to it. So even though we value clean air, or maybe we also value lack of distraction on, let's say, internet or so. At the moment, these quantities, you know, companies, corporations can pollute them for free. So, in some sense,”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Best solution to such problems is, I guess, technology. So, I mean, if they would know that you can just boil water and then drink it after, then that would save the recidivization. And even now when we look actually at the current pandemic, it seems that once again science comes to rescue. And somehow science increases size of the action space. And I think that's a good thing.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So let's see. I think it kind of depends on the cataclysm. We have observed in other parts of the universe that birds of gamma rays are high energy rays of light that actually can apparently kill entire galaxy. So there might be actually nothing to protect us from it. I'm also, when I'm looking actually at the past civilization, so it's like Aztecs or so, they disappear from the surface of the Earth and one can ask, why is it the case? The way I'm thinking about it is that definitely they had some problem that they couldn't solve. And maybe there was a flat and all of a sudden they couldn't drink a, there was no potable water and they all died. Think that so far.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“It also feels one of the problems is that speed of light is low and universe is vast. And it seems that actually most likely, if we want to travel very far, then we would instead of actually sending spaceships with humans that wait a lot, we would send something similar to what Yuri Miller is working on. These are like a huge sail, which is at first powered, there is a shot of laser from an Earth, and it can propel it to quarter of speed of light. And sale itself contains a few grams of equipment. And that might be the way to actually. Transport matter through universe. But then when you think what would it mean for humans, it means that we would need to actually put their 3D printer and 3D print a human on other planet. I don't know, play the YouTube or let's say, or like a 3D print like huge human right away or maybe a womb or so.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, one of the things that Alliance might want to do if they are truly optimizing to maximize amount of compute, which maybe can lead to more, let's say, simulations or so, it's instead of wasting current entropy of the universe, because we by living, we are actually somewhat wasting entropy, then you can wait for the universe to cool down such that you have more computation. So that's kind of a funny answer. I'm not sure if I believe in it, but that would be one of the reasons why you don't see aliens. It's also possible, see, some people say that maybe there is not that much point in actually going to other galaxies if you can go inwards. So there is no limits of what could be an experience if we could connect machines to our brains. While there are still some limits, if we want to explore universe.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“The moment my belief that it is unique, but I would say I could also, you know, there is like some footage released with UFO objects. Which makes me actually doubt my own belief Yeah, I can tell you one crazy answer that I have heard. So, apparently, when you look actually at the limits of computation, you can compute The temperature of the universe would drop down.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Don't have a conviction in the answer, but rather kind of probabilistic perspective on what might be possible answers. It's also interesting that the question itself even can touch on your typical question of what's the meaning of life. Because if you assume that we don't see aliens because they destroy themselves, that kind of upweights the... Focus on making sure that we won't destroy ourselves At the moment, the place where I am actually with my belief, and these things also change over the time, is I think that we might be alone in the universe, which actually makes life more or less consciousness life more kind of valuable. And that means that we should more appreciate it.”
2021-08-29 · Lex Fridman Podcast · #215 – Wojciech Zaremba: OpenAI Codex, GPT-3, Robotics, and the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source