YouSaid · the spoken record

David Chalmers

lines on the record
61
first
2015-11-15
most recent
2015-11-15
sittings or episodes
1
sources
podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

  1. And so, within the field of reinforcement learning, there's a whole little subfield called model based reinforcement learning, which is all about trying to do it by building a model, which you can then potentially use in this rehearsal sort of way. But although Rich Sutton, who's the sort of father of reinforcement learning in his book way back in 1997, he proposes architectures in which these things are blended together very nicely. But I don't think anybody's really built that in a very satisfactory way quite yet.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  2. Yeah, I think it's actually one of the potentially hot topics to incorporate into machine learning in the not too distant future. So one of the fundamental techniques in DeepMind's work is reinforcement learning.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  3. Bits of our brains light up, and if I imagine punching you, then actually the parts of my brain that will be involved in punching you are partly, fortunately, they're not actually punching you. There's more to it than just sort of thinking of the scenario. In some sense, the brain does rehearse the scenario in other ways, doesn't it?

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  4. So, what is inner rehearsal exactly? So I think that the sort of architecture of intelligence is putting all of those aspects together, really. So the inner rehearsal is when we close our eyes, of course we're not really necessarily going to close our eyes, especially if we're on the underground. But it's when we close our eyes and imagine going through some particular scenario. Imagine doing an action and inwardly realizing that this will be a good or this would have a bad outcome.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  5. Or if you have a system that can learn from that, the sort of dynamics of the world and the statistics of actions and their effects and so on, then it can use that. So it sort of builds a model of how the world works. And then it can use that model to construct imaginary scenarios and rehearse imaginary scenarios. Actually, just going back very quickly to the deep mind DQN. So in fact, one of the bit of work that they actually published, I think one of its shortcomings actually is that in fact although it has done all that learning about what the right action to do in the right circumstance is, it doesn't actually do in a rehearsal. It doesn't actually work through scenarios. Oh, it's just remembering.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  6. Oh, well, that's another thing you can have sort of avatars, but what I mean by vicarious embodiment is that it uses the embodiment of others and to gather data, for example, the enormous repository of videos there are on the internet. There are zillions of videos of people picking up objects and putting things down and moving around in the world. And so potentially it can learn in that vicarious way everything that it needed to learn by being actually embodied itself.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  7. So certainly, I would have taken a stance if you'd asked me 10 years ago that cognition and intelligence is inherently embodied because what our brains are really for is to help us get around in this world of three-dimensional space and complex objects that move around in that three-dimensional space and that everything else about our intelligence, our language, our problem-solving abilities built on top of that. Now, I'm not totally sure that it's not impossible that it's not possible to build AI that is kind of disembodied. Maybe in my latest book, I use the phrase vicarious embodiment, or I should say vicarious embodiment for a US audience.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  8. Yeah, absolutely. It's a completely distributed intelligence and it's not embodied in quite the sense of, of course, a car is a kind of robot in a wave. It's a self-driving car, but it's not really an embodied intelligence. It's sort of disseminated or distributed throughout the internet. And it's a kind of presence. So I can imagine that in the future, rather than the AI necessarily being the stereotype of a robot standing in front of us, it's going to be something that sort of is hidden away on the internet and is a kind of ambient presence that goes with us wherever we go.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  9. Yeah, there's a long subtitle which is Cognition and Consciousness in the Space of Possible Minds. And I very much like that phrase, the space of possible minds. I think if you were to kind of pin me down on what I think is my most fundamental and deepest interest, it's this idea that what constitutes possible minds is much larger than just humans or even the animals that we find on this earth, but also encompasses the AI that we might create in the future, either robots or disembodied AI.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  10. I saw that movie three times in the theater, so I will remember it. Oh, fantastic. So there's a point in the film where Caleb is typing into a screen to try and crack the security and then some code flashes up on the screen at that point. And that code was actually written by me.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source

  11. What was that like? Oh, it was tremendous fun, actually. So I got an email out of the blue from Alex Garland, famous author. So that was very exciting to get this email. And the email said, oh, my name's Alex Garland. I've written a few books and stuff. And I read your book on consciousness, embodiment in the inner life. And I'm working on a film about artificial intelligence and consciousness. And would you like to kind of get together and talk about it? So, of course, I jumped at the chance and we met and had lunch and I read through the script and he wanted a bit of feedback on the script as well, whether it hung together from the standpoint of somebody working in the field. And then we met up several times while the movie was being filmed and I have a little Easter egg in the film.

    2015-11-15 · a16z Podcast · a16z Podcast: Artificial Intelligence and the 'Space of Possible Minds' · IDENTIFIED FROM THE TRANSCRIPT · source