YouSaid · the spoken record

François Chollet

lines on the record
161
first
2020-08-31
most recent
2020-08-31
sittings or episodes
1
sources
podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

  1. “Even if you're writing a paper, for instance, don't you have a spatial representation of your paper? You visualize where ideas lie topologically in relationship to other ideas, kind of like a subway map of the ideas in your paper.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  2. “Visual analogies and motion is a fundamental building block of the mind and you actually see it reflected in language. That language is full of special metaphors. And when you think about things, I consider myself very much as a visual thinker. You often express his thoughts by using things like visualizing concepts in 2D space or like you solve problems by imagining yourself, navigating a concept space. I don't know if you have this sort of experience.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  3. “Yeah, I think so. So the mind is layers, right? And language is almost like the outermost, the uppermost layer. But before we think in words, I think we think in terms of motion in space and we think in terms of physical actions. And I think babies in particular probably express his thoughts in terms of the actions that they've seen or that they can perform and in terms of motions of objects in their environment before they start thinking in terms of worlds.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  4. “Yes. Ping language is a layer on top of cognition. So it is fundamental to cognition in the sense that to use a computing metaphor, I see language as the operating system of the brain, of the human mind. The operating system is a layer on top of the computer. The computer exists before the operating system, but the operating system is how you make it truly useful.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  5. “You can program your own memory, and language is actually the tool you used to do that. I think language is a kind of operating system for the mind and use language, well, one of the uses of language is as a query that you run over your own memory, use words as keys to retrieve specific experiences of the sick concept, specific starts. Like language is a way you store thoughts, not just in writing, in the physical world, but also in your own mind. And it's also how you retrieve them. Like imagine if you didn't have language, then you would have to, you would not really have a self-internally triggered way of retrieving past thoughts. You would have to rely on external experiences. For instance, you see a specific site, you smell a specific smell, and that brings up memories, but you would not really have a way to deliberately deliberately.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  6. “Yes, the brain is more of a sparse access memory so that you can actually retrieve very precisely like bits of your experience.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  7. “Ideas of hierarchies in AI have been around for a long time, even before art intelligence, they've been around since the 1980s. And yeah, that was before deep learning. But of course, I think these idea is really found their practical implementation in deep learning.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  8. “The notion that cognition is prediction was an idea that was kind of new to me at the time that I really loved at the time. And yeah, and the notion that there are multiple scales of processing in the brain. Yes.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  9. “Compression functions or prediction functions. I thought it was really, really interesting and it reshaped the way it started thinking about how to build mines.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  10. “Guess both. Jean-Pierre is the author that really introduced me to the notion that intelligence and the mind is something that you construct throughout your life and that children construct it in stages. And I thought that was a very interesting idea, which is, of course, very relevant to AI, to building artificial minds. Another book that I read around the same time that had a big impact on me And there was actually a little bit of overlap with Jean-Pierre as well, and I read it around the same time, is Jeff Hawkins on intelligence, which is a classic. And he has this vision of the mind as a multi-scale hierarchy of temporal prediction modules. And his ideas really resonated with me, like the notion of a modular hierarchy of potentially”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source

  11. “So one author that had a big impact on me when I read his books as a teenager was Jean-Piaget, who is a Swiss psychologist, is considered to be the father of developmental psychology, and he has a large body of work about basically how intelligence develops in children. And so it's fairly old work, like most of it is from the 1930s, 1940s. So it's not quite up to date. It's actually superseded by many newer developments in developmental psychology. But to me, it was very, very interesting, very striking, and actually shaped the early ways in which I started thinking about the mind and development of intelligence as a teenager.”

    2020-08-31 · Lex Fridman Podcast · #120 – François Chollet: Measures of Intelligence · IDENTIFIED FROM THE TRANSCRIPT · source