YouSaid · the spoken record

Karl Friston

lines on the record: 90
first: 2020-05-28
most recent: 2020-05-28
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“Tried to avoid too much interpersonal contact, enjoy the fantasy. You're a popular scientist who's going to make a difference in a slightly quirky way. That's where I grew up on. My father was an engineer and loved science. Things like Sir Arthur Enter's spacetime and gravitation, which was the first understandable version of general relativity. So all the fairy stories I was told as I was growing up were all about these characters keeping the hobby out of this because that was quite my narrative. There's a journey of exploration, sorts. So yeah, I've just grown up to being what I imagine a mild-mannered Sherlock Holmes slash Albert Einstein would do in my shoes.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Exactly, that narrative that has been encultured by your immediate family, but as you say, also the sort of the culture which you grew up, and you create for yourself. I mean, again, because of this active inference, this inactive aspect of self-evidencing. not only am I modeling my environment, my eco niche, my external states out there, but I'm actively changing them all the time and external states are doing the same back, we're doing it together. So there's a synchrony that means that I'm creating my own culture of different timescales. So the question now is for me being very selfish. What scripts were I given? Basically, it was a mixture between Einstein and Shercolmes. So I smoke as heavily as possible.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Reassuringly simple and harps back to what you were taught as a child, that you have certain beliefs about the kind of creature and the kind of person you are. All that self-evidencing means, all that minimizing variational free energy in an inactive and embodied way means is fulfilling the beliefs about what kind of thing you are. And of course, we're all given those scripts, those narratives at a very early age, usually in the form of bedtime stories or fairy stories that I'm a princess and I'm going to meet a beast who's going to transform and it's going to be a prince.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm tempted to answer that again as a physicist, the Free Energy I expect consequent upon my behavior. So technically, we can get a really interesting conversation about what that comprises in terms of Searching for information, resolving uncertainty about the kind of thing that I am. But I suspect that you want a slightly more personal and fun answer. But which can be consistent with that, and I think it's”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Singing together in a choir. That was just probably not a brilliant analogy of what I'm trying to say. But we wouldn't have this discourse”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“I mean, when we talk about planning, or when you talk specifically about planning the highest, if you like, manifestation or realization of that planning is what we're doing now. I mean, the human condition doesn't get any higher than this, talking about the philosophy of existence and the conversation. But in that conversation, there is a beautiful art of turn taking and mutually inference, theory of mind. I have to know when you want to listen, I have to know when you want to interrupt. I have to make sure that you're online. I have to have a model in my head of your model in your head. That's the highest, the most sophisticated form of generative model, where the generative model actually has a generative model of somebody else's generative model. And I think that and what we are doing now evinces the kinds of generative models that would support self-awareness. Because without that, we'd both be talking over each other.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Absolutely well, we imbue a lot of our attributes into our pets, don't we? Or we try to make our robots humanoid. And I think there's a deep reason for that, that it's just much easier to read the world if you can make the simplifying assumption that basically you're me and it's just your turn to talk.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“An inference that a hypothesis, ah yes, it is me that is experiencing or causing these sounds, and it is not you. It's only when the zambiguity in play, induced by the fact that there are others in that world. So I think that the special thing about self aware artifacts is that they have learned to or they have acquired, or at least are equipped with possibly by evolution, generative models that allow for the fact there are lots of copies of things like them around. And therefore they have to work out it's you and not me.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“I have to have a model that is effectively fit for purpose for this kind of world in which I operate. And if I now make the observation that this kind of world is effectively largely populated by other things like me, i. e. you That it makes enormous sense that if I can develop a hypothesis that we are similar kinds of creatures, in fact the same kind of creature, but I am me and you are you, then it becomes again mandated to have a sense of self. So if I live in a world that is constituted by things like me, basically a social world, a community, then it becomes necessary now for me to infer that it's me talking and not you talking. I wouldn't need that if it was on Mars by myself. Or if I was in the jungle as a feral child if there was nothing like that. There's nothing like me around, there would be no need to have”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Of course, the big problem is writing down the generative model. So that's where the heavy lifting comes in. So it's the form and the structure of that generative model which basically defines the artifact that you will create, or indeed the kind of artifact that has self awareness. So that's where all the hard work comes, very much like natural selection doesn't tell you in the slightest why you have eyes. So you have to drill down on the actual phenotype, the actual generative model. With that in mind, what did you tell me that tells me immediately the kinds of generative models I would have to write down in order to have self-awareness? What you said to me was...”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Probabilistically, and then you engineer a lot of hard work, but you would engineer a robot and a computer to perform a gradient descent on that objective function. So it does have a practical implication. Now, why am I wittering on about that? It did seem relevant to, yes, so what kinds of, so the answer to would it be easy or would it be hard? Well, mathematically it's easy. I've just told you all you need to do is write down your perfect artifact probabilistically in the form of a probabilistic generative model, a probability distribution over the causes and consequences of the world in which this thing is immersed. And then you just engineer a computer and a robot to perform a great intercent on that objective function. No problem.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“That supplies the self organizing dynamics to non equilibrium steady state. So there is actually a practical application of the free energy principle when you can write down your required evidence in terms of, well, when you can write down the generative model. That is the thing that has the evidence, the probability of these sensory data or this data given that model is effectively the thing that the elbow or the variational free energy bounds or approximates. That means that you can actually write down the model. And the kind of thing that you want to engineer, the kind of AGIOD artificial general intelligence. That you want to manifest”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Don't get from natural selection, but you could say has now manifest in things like differential evolution or genetic algorithms or MCMC, for example, in machine learning. The practical thing you can get is if it looks as if things exist are trying to have density dynamics that look as though they're optimizing a variational free energy and a variational free energy has to be a function of a generative model, a probabilistic description of causes and consequences, causes out there, consequences in the sensorium on the sensory parts of the Markov blanket, then it should in theory be possible to write down the generative model, work out the gradients, and then cause it to autonomously self evidence. So you should be able to write down oil droplets. You should be able to create artifacts where you have supplied the objective function that supplies the gradients.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“By itself is as vacuous as most tautological theories. And by tautological, of course, I'm talking to the theory of the survival of the fittest. What's the fittest survive? Why did this cycle, the fittest? It just garrounded circles. In a sense, the free energy principle has that same deflationary tautology under the hood. It's a characteristic of things that exist, why they exist, because they minimize their free energy, why they minimize their free energy, because they exist. And you just keep on going round and round and round. But the practical thing”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, yes or no. I don't think that perhaps we should just, can we just go back? But that's a very important answer you gave. And I think if I just unpacked it, you'd see the truisms that you've just exposed for us. But let me, sorry, I... I'm mindful that I didn't answer your question before. Well, what's the free entry principle good for? Is it just a pretty theoretical exercise to explain non-equilibrium steady states? Yes, it is. It does nothing more for you than that. It can be regarded. It's going to sound very arrogant, but it is of the sort of theory of natural selection or hypothesis of natural selection. Beautiful, undeniably true, but tells you absolutely nothing about why you have legs and eyes. It tells you nothing about the actual phenotype and it wouldn't allow you to build. Something. So the free energy principle.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“So I think you've now got to a situation if there is planning in the mix, you're now getting much closer to that line, if that line were ever to exist, I don't think it gets you quite as far of self-aware, though. I think you have to, I think, grapple with the question. How would formally write down a countless or a maths of self awareness? I don't think it's impossible to do. But I think there would be pressure on you to actually commit to a formal definition of what you mean by self-awareness. I think most people that I know would probably say that a goldfish, a pet fish, was Not self aware they would probably argue about their favourite cat, but would be quite happy to say that they were”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Then you've got to have movement in the game. And furthermore, you've got to have a generative model of the sort you might find in say a variational autoencoder that is thinking about the future conditioned upon different courses of action. Now that brings a number of things to the table which now you start to think, well those who've got all the right ingredients to talk about consciousness. I've now got to select among a number of different courses of action into the future as part of planning. I've now got free will. The act of selecting this course of action or that policy or that policy or that action. Suddenly makes me into an inference machine, a self evidencing artifact that now looks as if it's selecting amongst different alternative ways forward, as I actively swim here or swim there or look over here, look over there.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“away from big data and machine learning because again it's the consequences of moving. It's the consequence of selecting those data or those data or looking over there. And that tells you immediately that even to be a contender for a conscious artifact or is it strong AI or generalized?”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Having said that, I grieve you entirely. Systems that have the ability to plan. So just technically, what that means is your inferential self-evidencing by which I simply mean the dynamics, literally the thermodynamics and gradient flows that underwrite the preservation of your oil droplet-like form are described as an optimization of log Bayesian model evidence, your elbow. That self-evidencing must be evidence for a model of what's causing the sensory impressions on the sensory part of your surface or your Markov blanket. If that model is capable of planning, it must include a model of the future consequences of your active states or your action, just planning. So we're now in the game of planning as inference. Now notice what we've made though. We've made quite a big move.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Will be very nice, one little wrinkle there, and this is something I've only learned in the past few months, is the philosophical notion of vagueness. So you're saying it would be wonderful to draw a line. I had always assumed that that line at some point would be drawn until about four months ago, and the philosopher taught me about vagueness. So I don't know if you've come across this, but it's a technical concept. And I think most revealingly illustrated with at what point does a pile of sand become a pile? Is it one grain, two grains, three grains, or four grains? So at what point would you draw the line between being a pile of sand and a collection of grains of sand? In the same way, is it right to ask where would I draw the line between conscious and unconscious? And it might be a vague concept.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Does have a form of agency in virtue of the way that it selectively finds hosts and cells to live in and moves around, but you wouldn't endow it with the capacity to think about planning and moving in a purposeful way where it countenances the future. Whereas you might an ant. You might think an ant's not quite as unconscious as a virus. It certainly seems to have a purpose. It talks to its friends en route during its foraging. It has a different kind of autonomy, which is biotic, but beyond a virus.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Again, I'm not sure that I'm licensed to answer that question. I think you'd have to speak to a qualified philosopher to get a definitive answer there. But certainly there's a lot of interest in using. Not just these ideas but related ideas from information theory to try and tie down the maths and the calculus and the geometry of consciousness either in terms of a minimal consciousness a minimal selfhood what I'm talking about is the ability effectively to plan So have agency. So you could argue that a virus”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“But an oil drop that enjoys exposure to nearly all the data will ever need to be exposed to, as opposed to the temples swimming out to find the right data. For example, it likes food. That's a good hypothesis. Let's test it down. Let's go and move and ingest food, for example, and see what that, you know, is that evidence that I'm the kind of thing that likes this kind of food.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“I think as yet to really hit machine learning. It certainly has now diffused itself throughout robotics and perhaps you could say certain problems in active vision where you actually have to move the camera to sample this and that. But machine learning of the data mining deep learning sort simply hasn't contended with this issue. What it's done instead of dealing with the movement problem and the active sampling of data is said we don't need to worry about we can see all the data because we've got big data. So that for me is an important omission in current machine learning.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“But to now equip that oil drop with the ability to go out and test that hypothesis about different states of beings so it can actually push its surface over there, over there and test for chemical gradients, or then you start to move to much more lifelike form. This old fun theoretically interesting, but it actually is quite important in terms of reflecting what I have seen since the turn of the millennium, which is this move towards an inactive, an embodied understanding of intelligence. And you say you're from machine learning So, what that means, this sort of the central importance of movement.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Internal dynamics that are not only modelling the data impressed upon their surface or the blanket states, but they are actively resampling those data by moving. They're moving towards chemical gradients and chemotaxis. So they've gone beyond just being good little models of the kind of world they live in, for example an oil droplet could, in a panpsychic sense, be construed as a little being that has now perfectly inferred it's a passive non living oil drop living in a bowl of water. No problem.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“So it's that non randomness. So, and that would be manifest. It would be realized in terms of essentially swimming, essentially moving, changing one shape, amorphogenesis that is dynamic and possibly adaptive so that that's what I was trying to get out between the difference between the oil drop and the little tadpole. The tadpole is moving around its active states are actually changing the external states and there's now a cycle, an action perception cycle if you like, a recurrent dynamic that's going on that depends upon this deeply structured autonomous behavior that rests upon”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“It can certainly have a very active surface, but en masse at the scale of the actual surface of the sun, the average position of that surface cannot in itself move, because the internal dynamics are more like a hot gas, they are literally like a hot gas, whereas your internal dynamics are much more structured and deeply structured, and now you can express on your markov and your active states with your muscles and your secretory organs, your autonomic nervous system, and its effectors, you can actually move That's all you can do, and that's something which if you haven't thought of it like this before, I think it's nice to just realize there is no other way You can change the universe other than simply moving. Whether that moving is articulating with my voice box or Or walking around, or squeezing juices out of my secret organs.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“What I mean is that the internal states that can influence the active states, where the active states can influence, but they're not influenced by the external states, can cause movement. So there are two types of oil drops, if you like. There are oil drops where the internal states are so Random that they average themselves away. And the thing cannot on earth. balance on average when you do the averaging move. So a nice example of that would be the sun. The sun certainly has internal states, there's lots of intrinsic autonomous activity going on, but because it's not coordinated, because it doesn't have the deep in the millennial sense a hierarchical structure that the brain does, there is no overall mode or pattern or organization that expresses itself on the surface, that allows it to actually swim.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm trying to say is you're absolutely right, you've nailed it. Its movement. So, where does that movement come from? If it comes from the inside, then you've got, I think, something that's living.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“You're being too clever. I didn't find a passive little oil drop that was sitting there. At the bottom on the top of a glass of water.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Now we make the next move. But what about living things? I mean, so let me ask you, what's the difference between an oil drop and a little tadpole or a little lava?”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“The blanket separates them. So, what does that mean? Well, it means the active states, the internal states are now jointly not influenced by external states. They only have autonomous dynamics. So now you've got a picture of an oil drop that has autonomy. It has autonomous states. It has autonomous states in the sense that there must be some parts of the surface of the oil drop that are not influenced by the external states and all the interior, and together those two states endow even a little oil drop with autonomous states that look as if they are optimizing their variational free energy or their negative elbow, their model evidence. And that would be an interesting intellectual exercise. And you could say, you could even go into the realms of panpsychism, that everything that exists is implicitly making inferences on self-evidencing.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“What would they be called if you were trying to describe these things? So what we're talking about are internal states, external states and blanket states. Now let's carve the blanket states into two sensory states and active states. Operationally it has to be the case that in order for this carving up into different sets of states to exist the active states the Markov blanket cannot be influenced by the external states. And we already know that the internal states can't be influenced by the”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“On the same quantity. And that means that you can now describe the very existence of this oil drop. You can write down the existence of this oil drop in terms of flows, dynamics, equations of motion, where the blanket states, or part of them we call them active states, and the internal states now seem to be and must be trying to look as if they're minimizing the same function, which is a log probability of occupying these states. The interesting thing is that”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“So, this surface or this blanket states that Because they are now defined in relation to these independences and what different states internal or blanket or external states, which ones can influence each other and which cannot influence each other. You can now apply standard results that you would find in non-equilibrium physics or steady state or thermodynamics or hydrodynamics, usually out of equilibrium solutions and apply them to this partition and what it looks like is if all the Norman gradient flows that you would associate with any non equilibrium system apply in such a way that two part of the mark of blanket and the internal states seem to be hill climbing or doing a great deal.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“of the oil drop from the water in which it is immersed. And when you do that, you start to realize well there are actually four kinds of states in any given universe that contains anything. The things that are internal to the surface, the things that are external to the surface, and the surface in and of itself, which is why I use a metaphor a little single celled organism that has an interior and exterior, and then the surface of the cell. And that's mathematically a Markov blanket.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“So the step through to answer your question about what's it good for go along the following lines. First of all, you have to define what it means to exist, which now, as you've rightly pointed out, you have to define what probabilistic properties must the states of something possess so that it knows where it finishes. And then you write that down in terms of statistical independences again sparsity, again it's not what's connected or what's correlated or what depends upon what it's what's not correlated and what doesn't depend upon something. Again, it comes down to the deep structures, not in this as hierarchical, but the structures that emerge from removing connectivity and dependency. And in this instance, basically being able to identify the”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I think there is. Things do exist, grains of sand, rocks on the moon, trees. So all of these things can be separated from the environment in which they are immersed and therefore there must at some level be optimizing their free energy, taking this sort of model evidence interpretation of this quantity that basically means they're self-evidencing. Another nice little twist of phrase here is that you are your own existence proof statistically speaking, which I don't think I said that somebody did, but I love that phrase.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“That's an excellent question. But to answer that, I have to return to your previous question about what's the difference between living and non-living things. Yes, it was.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“where they clearly demarcate themselves from the states or the soup in which they are immersed. So from the point of view of computational chemistry, for example, you would just understand that as a configuration of a macro molecule to minimize its free energy, its thermodynamic free energy is exactly the same principle that we've been talking about that thermodynamic free energy is just the negative elbow. It's the same mathematical construct. So the very emergence of existence, of structure, of form that can be distinguished from the environment or the thing that is not the thing necessitates the existence. Of an objective function that it looks as if it is minimizing. It's finding a free energy minima.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“If something exists, then it must display these properties. That's the thing that's on offer, and it so happens that these properties it must display are actually intriguing and have this inferential gloss, this sort of self-evidencing gloss that inherits from the fact that the very preservation of the boundary between the oil drop and the not oil drop requires an optimization of a particular function or a functional that defines the presence of the existence of this oil, which is why I started with existential imperatives. It is a necessary condition for existence that this must occur because the thing,”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Begin right. So, I mean, you're asking deep questions deep in a non millennial sense. But what you can do is this is the deflationary part of it. Can I just qualify my answer by saying that normally when I'm asked this question, I answer from the point of view of a psychologist when we talk about predictive processing and predictive coding and the brain as an inference machine, but you haven't asked me from that perspective, I'm answering from the point of view of a physicist. So the question is not so much why, but if it exists, what properties must it display? So that's the deflationary part of the free energy principle. The free energy principle does not supply an answer as to why. It's saying”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“So, what special properties of the exchange between the surface of the oil drop and the external states in which it's immersed if your physicists say it would be the heat bath? You've got a physical system, an ensemble again. We talk about density dynamics, ensemble dynamics, an ensemble of atoms or molecules immersed in the heat bath. But the question is, how did the heat bath get there and why is it not dissolved?”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm imagining a range of systems at its simplest organism that can be identified from its eco niche or its environment. So at its simplest, that's basically what I always imagined in my head. And you may ask, well, is there any, how on earth... Can you even elaborate questions about the existence of a single drop of oil, for example? There are deep questions there why doesn't the oil why doesn't the thing the interface between the drop of oil that contains an interior and the thing that is not the drop of oil which is the solvent in which it is immersed how does that interface persist over time? Why doesn't the oil dissolve into solvent?”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Exhibit properties that make it look as if it is optimizing a particular quantity, and it turns out that particular quantity happens to be exactly the same as the evidence lower bounded machine learning, or Bayesian model evidence in Bayesian statistics, or and that I can list a whole other list of ways of understanding this key quantity, which is a bound on surprisal, self-information theory. There are a number of different perspectives on this continent. It's just basically the log probability of being in a particular state. I'm telling this story as an honest and attempt to answer your question. And I'm answering it as if I was pretending to be a physicist who was... Trying to understand the fundaments of non equilibrium steady state. And I shouldn't really be doing that because the last time I... Was taught physics. I was in my 20s.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Right. You've made a big move there. Apologies. It's good to make big moves. But you've assumed that the thing exists in a state that could be living on non-living. So I may ask you what licenses you to say that something exists. That's why I use the word existential. It's beyond living. It's just existence. So if you drill down onto the definition of things that exist, then they have certain properties if you borrow the maths from non equilibrium steady state physics that Enable you to interpret their existence in terms of this optimization procedure. So it's could you introduce the word optimization? So what the free energy principle in its sort of most ambitious but also most deflationary and simplest says is that if something exists, then it must the mathematics of non-equilibrium steady state”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“in virtue of being separate from the environment in which it exists as trying to minimize variational free energy and if you're from the machine learning community you will know that as a negative evidence lower bound or a negative elbow which is the Or it will look as if all your dynamics are trying to maximize the complement of that which is the marginal likelihood or the evidence for your own existence. So that's basically the free energy principle”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“On the one hand, but I should also acknowledge it inherits an awful lot from machine learning as well. So the free energy principle is just a formal statement that the existential imperatives for any system that manages to survive in a changing world can be cast as an inference problem in the sense that you can interpret the probability of existing as the evidence that you exist. And if you can write down that problem of existence as a statistical problem, then you can use all the maths that has been developed for inference to understand and characterize the ensemble dynamics that must be in play in the service of that. So technically, what that means is you can always interpret anything that exists.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source
“Where, in fact, the free energy principle inherits a lot from the building of these data analytic approaches to these very high dimensional time series you get from the brain. So I think it's interesting to acknowledge that. And in particular, the analysis tools that try to address the other side, which is a functional integration, so the connectivity analyses.”
2020-05-28 · Lex Fridman Podcast · #99 – Karl Friston: Neuroscience and the Free Energy Principle · IDENTIFIED FROM THE TRANSCRIPT · source