YouSaid · the spoken record

Yann LeCun

lines on the record: 182
first: 2024-03-07
most recent: 2024-03-07
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“So, I share that feeling. I think people are found too good. And in fact, a lot of doomers are doomers because they don't think that people are fundamentally good. And they either don't trust people or they don't trust the institution to do the right thing so that people behave properly.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Now, what's the analogy for AI today? Like, who are we protecting by banning AI? Who are the people who are asking that AI? Be regulated to protect the jobs. And of course, it's a real question of what is going to be the effect of technological transformation like AI on the job market and the labor market and their economists who are much more expert at this than I am. But when I talk to them, they tell us. You know, we're not going to run out of job. There's not going to cause mass unemployment. There's just going to be gradual shift of different professions. The professions that are going to be hot 10 or 15 years from now. Have no idea today what they're going to be. The same way if we go back 20 years in the past, who could have thought?”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“And he didn't ban it for all languages, only for Arabic. You could actually print books in Latin or Hebrew or whatever in the Ottoman Empire, just not in Arabic. Thought it was because the wheelers just wanted to preserve the control over the population and the dogma, religious dogma and everything. But after talking with the UAE Minister of AI, Omar Olama. He told me, no, there was another reason. And the other reason was that it was to preserve the corporation of calligraphers. There's like an R form, which is writing those beautiful. Arabic poems or whatever religious text in this thing. And it was very powerful cooperation scribes basically that kind of ran a big chunk of the empire. And we couldn't put them out of business. So they banned the Pijing press in part to protect that business.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“And so that created the Protestant movement and created the rift. And in fact, the Catholic school, the Catholic Church didn't like the idea of the printing press, but they had no choice. And so it had some bad effects and some good effects. I don't think anyone today would say that the invention of the printing press had an overall negative effect, despite the fact that it created 200 years of religious conflicts in Europe. Now, compare this. And I thought I was very proud of myself to come up with this analogy, but realized someone else came with the same idea before me. Compare this with what happened in the Ottoman Empire. The Ottoman Empire banned the printing press for 200 years.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Certainly with others, there wouldn't have been the American Revolution or the French Revolution. And so still be under a feudal regimes perhaps. And so it completely transformed the world because people became smarter and kind of learned about things. Now, it also created 200 years of essentially religious conflicts in Europe, right? Because the first thing that people read was the Bible and realized that perhaps there was a different interpretation of the Bible than what the priests were telling them.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Helps the communication of information and knowledge and the transmission of knowledge. So AI is going to make humanity smarter. And the analogy I've been using Is the fact that perhaps an equivalent event in the history of humanity to what might be provided by journalization of AI assistant is the invention of the printing press. It made everybody smarter. The fact that People could have access to books. Books were a lot cheaper than they were before. And so a lot more people had an incentive to learn to read, which wasn't the case before. People become smarter. It enabled the enlightenment. There wouldn't be an enlightenment without the printing press. It enabled Philosophy, rationalism. Escape from religious doctrine Democracy.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Certainly, I have a lot of experience with this, of having people working with me who are smarter than me. That's actually a wonderful thing. So having machines that are smarter than us that assist us in all of our tasks, our daily lives, whether it's professional or personal, I think would be absolutely a wonderful thing. Because intelligence is the most Is the commodity that is most in demand? That's really what, I mean, all the mistakes that humanity makes is because of lack of intelligence, really, or lack of knowledge, which is related. So making people smarter can only be better. I mean, for the same reason that public education is a good thing. Books are a good thing, and the internet is also a good thing intrinsically, and even social networks are a good thing if you run them properly. It's difficult, but you can. Because”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Love that question. Can make humanity smarter with AI. Okay, I mean, AI basically will amplify human intelligence. As if every one of us will have a staff of smart AI assistants, they might be smarter than us. Do Perhaps execute a task in ways that are much better than we could do ourselves because they'd be smarter than us. And so it's like everyone would be the boss of a staff of super smart virtual people So we shouldn't feel threatened by this any more than we should feel threatened by being the manager of a group of people, some of whom are more intelligent than us.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“In AI. Where the various levels of representations that are necessary have been learned. We can do like two-level hierarchical planning when we design the two levels. So for example, you have a dog-like robot, right? You want it to go from Living room to the kitchen, you can plan a path that avoids the obstacle. And then you can send this to a lower level planner that figures out how to move the legs to kind of follow that trajectories, right? So that works, but that two level planning is designed by hand, right? We specify what the proper levels of abstraction, the representation at each level of abstraction have to be. How do you learn this? How do you learn that hierarchical representation of action plans With covenants and deep learning, we can train the system to learn hierarchical representations of percepts.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“How do you get a system to actually plan a sequence of actions to give the solution to a problem? And so the question of planning is not just a question of planning physical actions. It could be planning actions to use tools for a dialogue system or for any kind of intelligence system. And there's some work on this, but not a huge amount. Some work at FAIR, one called Tool Former, which was a couple years ago, and some more recent work on planning. But I don't think we have a good solution for any of that. Then there is the question of hierarchical planning. So the example I mentioned of planning a trip from New York to Paris, that's hierarchical. But almost every action that we take involves hierarchical planning in some sense. And we really have absolutely no idea how to do this. Like there's zero demonstration of hierarchical planning.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So basically, I've listed them already. This idea of how do you train a world model by observation? And you don't have to train necessarily on gigantic data sets or. It could turn out to be necessary to actually try and enlarge data sets to have emergent properties like we have with LLMs. But I think there's a lot of good ideas that can be done without. Necessarily scatting up, then there is how do you do planning with a learned world model? If the world, the system evolves in, is not the physical world, but it's the world of At the internet, or some sort of world where an action consists in doing a search engine or interrogating a database or running a simulation or calling a calculator or solving a differential equation.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, I mean, I hope things work as planned. I mean, again, we've been kind of working on this idea of self-supervised learning from video for 10 years. And only made significant progress in the last two or three.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, it's not going to be necessarily. I mean, we have demos actually because there is a so-called embodied AI group at FAIR. And they've been not building their own robots, but using commercial robots. And you can tell robot dog go to the fridge. And they can actually open the fridge and they can probably pick up a can in the fridge and stuff like that and bring it to you. So it can navigate. It can grab objects as long as it's been trained to recognize them, which vision systems work pretty well nowadays. But it's not like a completely general. Robot that would be sophisticated enough to do things like. Up to dino table.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I mean, there's cleaning up. Can you house clearing up the table after Emil? Washing the dishes, you know, all those tasks, you know, cooking all the tasks that principle could be automated but are actually incredibly sophisticated, really complicated.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Certainly very far away from having level five autonomous driving by a system that can train itself by driving 20 hours like any 17 year old. So until we have, again, one models, systems that can train themselves to understand how the world works. We're not going to have significant progress in robotics. So a lot of the people working on robotic hardware at the moment are betting or banking on the fact that AI is going to make sufficient progress towards that.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Not soon, but it's going to happen. Like the next decade, I think, is going to be really interesting in robots. The emergence of the robotics industry has been in the waiting for 10, 20 years without really emerging other than for pre-programmed behavior and stuff like that. And the main issue is. Again, the Moravic paradox, like, you know, how do we get those systems to understand how the world works and kind of plan actions? And so we can do it for really specialized tasks. And the way Buston Dynamics goes about it is basically with a lot of handcrafted dynamical models and careful planning in advance, which is very classical robotics with a lot of innovation, a little bit of perception. But it's still not like they can't build a domestic robot. And we're still some distance away from completely autonomous level five driving”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“You trust institutions to do the right thing? Do you trust people to do the right thing? And yeah, there's bad people who are going to do bad things, but they're not going to have superior technology to the good people. So then it's going to be my good AI against your bad AI, right? I mean, it's the examples that we were just talking about of, you know, maybe some rogue country will build some AI system that's going to try to convince everybody Go into a civil war or something or elect favorable ruler. But then they will have to go past RAI systems”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Love it is because I see the danger of this concentration of power to proprietary AI systems as a much bigger danger than everything else. That if we really want a Diversity of opinion AI systems that. In the future, where we'll all be interacting through AI systems, we need those to be diverse for the preservation of diversity of ideas. Creeds and political opinions and whatever. And the preservation of democracy. What works against this is people who think that for reasons of security, we should keep AI systems under lock and key because it's too dangerous to put it in the hands of everybody. Because it could be used by terrorists or something. That would lead to potentially Very bad future in which all of our information diet is controlled by a small number of companies who proprietary systems.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah. Again, I think the answer to this is open source platforms and then enabling widely diverse set of people Build AI assistance that represent the diversity of cultures, opinions, languages, and value systems across the world so that you're not bound to just be brainwashed by a particular way of thinking because of single AI entity. So I think it's really, really important question for society. And the problem I'm seeing is that which is why I've been so vocal and sometimes a little sardonic about it.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Jazz or comic books being blamed for unemployment or young people not wanting to work anymore and things like that. And that has existed for centuries. And The question is do we embrace change? Or do we resist it What are the real dangers as opposed to the imagined ones?”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“If you fear for their culture, they feel for their job, they feel for the future of their children and their way of life. So any change is feared. And you see this along history, like any technological revolution or cultural phenomenon was always accompanied by groups or reaction in the media that basically attributed all the problems, the current problems of society to that particular change, right? Electricity was going to kill everyone at some point. The train was going to be a horrible thing because you can't breathe past 50 kilometers an hour. And so there's a wonderful website called a pessimist archive. Which has all those newspaper clips of all the horrible things people imagine would arrive because of... Either technological innovation or a cultural phenomenon. Is this wonderful examples of.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, there is a natural fear of new technology and the impact it can have on society. And people have kind of instinctive reaction to the world they know being threatened by major transformations that are either cultural phenomena or technological revolutions.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Even if there is just the fact that you know that something is possible Makes you realize that it's worth investing the time to actually do it. You may be the second person to do it. But you'll do it. And same for all the innovations of self-supervised learning transformers, decoder-only architectures, LLMs. I mean, those things, you don't need to know exactly the details of how they work. You know that it's possible because it's deployed and then it's getting reproduced. People who work for those companies move. They go from one company to another. And the information disseminates. What makes the success of the US tech industry and Silicon Valley in particular is exactly that. It's because information circulates really, really quickly and disseminates very quickly. And so the whole region sort of”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“No. As I said, it's not going to be an event. It's going to be a continuous progress. And whenever one breakthrough occurs, it's going to be widely disseminated really quickly. Probably first within industry. I mean, this is not a domain where government or military organizations are particularly innovative and they're in fact way behind. And so this is going to come from industry. And this kind of information disseminates extremely quickly. We've seen this over the last few years, right? Where you have a new, like, you know, even take AlphaGo. This was reproduced within three months. Without particularly detailed information”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“That's the history of the world. History of the world is, you know, whenever there is progress someplace, there is a countermeasure. And it's a cat and mouse game.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Is this thing like telling me the truth? It's not even going to be able to get to you because it's only going to talk to your AI system. Your AI system is not even going to, it's going to be like a spam filter, right? You're not even seeing the email, the spam email, right? It's automatically put in a folder that you never see. It's going to be the same thing. That AI system that tries to convince you of something is going to be talking to AI assistant, which is going to be at least as smart as it. Is going to say this is familiar, it's not even going to bring it to your attention.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, that AI system designed by Vladimir Putin, or whatever, or his minions is going to be talking to every American to convince them to vote for. Whoever pleases Putin. Or whatever, or rile people up against each other, as they've been trying to do. Not going to be talking to you, they're going to be talking to your AI assistant. Which is going to be as smart as theirs, right? That AI, because as I said, in the future, every single one of your interaction with the digital world will be mediated by your AI assistance. So the first thing you're going to ask is, is this a scam?”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Specialized in turbojet safety? No, the design is all about safety because a better turbojet is also a safer turbojet. So a more reliable one. It's the same for AI. Do you need specific provisions to make AI safe? No, you need to make better AI systems and they will be safe because they are designed to be more useful and more controllable.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I mean, those are incredibly complex pieces of hardware that run at really high temperatures for 20 hours at a time sometimes. And we can fly halfway around the world on a two-engine. Jetliner at near the speed of sound. How incredible is this? It's just unbelievable. We do this because we invented a general principle of how to make turbojet safe? No, it took decades to kind of fine tune the design of those systems so that they were safe. Is there Separate group within General Electric or Snackma or whatever that.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, of course, this is not a simple problem, right? I mean, designing those guardrails so that the system behaves properly is not going to be a simple issue for which there is a silver bullet, for which you have a mathematical proof that the system can be safe. It's going to be very progressive iterative design system where we put those guardrails in such a way that the system behaves properly. And sometimes they're going to do something that was unexpected because the guardware wasn't right and we're going to correct them so that they do it right. The idea somehow that we can't get it slightly wrong because if we get it slightly wrong, we all die is ridiculous. We're just going to go progressively. And it's just going to be the analogy I've used many times is turbojet design. How did we figure out how to make turbojet so...”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“There's all kinds of incentives to make AI systems submissive to humans. I mean, this is the way we're going to build them, right? And so then people say, oh, but look at LLMs, LLMs are not controllable. And they're right. LLMs are not controllable. But objective-driven AI, so systems that derive their answers by optimization of an objective means they have to optimize this objective. And that objective can include guardrails. One guardrail is Another guy realities don't obey humans if it's hurting other humans within humans.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“It is hardwired in humans. Is hardwired in baboons, in chimpanzees, in wolves, Not in the Wong Species in which this desire to dominate or submit or attain status in other ways Specific to social species. Non-social species like oralutons don't have it. And they are as smart as we are, almost.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Is the fact that because a system is intelligent, it necessarily wants to take over. And there is several arguments that make people scare of this, which I think are completely false as well. So one of them is, you know, in nature, it seems to be that the more intelligent species are the ones that end up dominating the other. Extinguishing the others sometimes by design, sometimes just by mistake. And so there is sort of thinking by which you say, well, if AI systems are more intelligent than us, surely they're going to eliminate us. If not by design simply because they don't care about us That's just prepossess they're not going to be a species. They're not going to be a species that competes with us Not going to have the desire to dominate because the desire to dominate is something that has to be hardwired into an intelligent system.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Smart as a cat have all the characteristics of human level intelligence, but their level of intelligence would be like a cat or a parrot, maybe, or something. And then we're going to work our way up to kind of make those things more intelligent. And as we make them more intelligent, we're also going to put some guardrails in them and learn how to kind of put some guardrails so they behave properly. And we're not going to do this with just one, it's not going to be one effort. It's going to be lots of different people doing this. And some of them are going to succeed at making intelligent systems that are controllable and safe and have the right guardrails. And if some other goes rogue, then we can use the good ones to go against the rogue ones. So it's going to be my smart AI police against your rogue AI. So it's not going to be like, you know, we're going to be exposed to like a single rogue AI that's going to kill us all. That's just not happening. Now, there is another fallacy, which”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Okay, so AI doomers imagine all kinds of catastrophes scenarios of how AI could escape or control and basically kill us all. And that relies on a whole bunch of assumptions that are mostly false So, the first assumption is that the emergence of superintelligence is going to be an event. That at some point we're going to figure out the secret and we'll turn on a machine that is super intelligent because we've never done it before it's going to take over the world and kill us all. That is false. It's not going to be an event. We're going to have systems that are like”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“But then if you are talking about other intelligent entities for which the The basic things that are easy to them is very different. Then it doesn't mean anything. So intelligence is a collection of skills. And an ability to acquire new skills efficiently. And the collection of skills that an particular intelligent entity possess or is capable of learning quickly is different from the collection skills of another one. Because it's a multidimensional Multidim”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, IQ can measure approximately something for humans. But because humans can come in relatively kind of uniform form, right? But it only measures one type of ability that may be relevant for some tasks, but not others.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“I don't think it's just Morvex Paradox. Marx Paradox is a consequence of realizing that the world is not as easy as we think. So, first of all, intelligence is not a linear thing that you can measure with a scalar, with a single number. Can you say that humans are smarter than... Wrong with tongues? In some ways, yes. But in some ways, Orangutongs are smarter than humans in a lot of domains that allows them to survive in the forest, for example.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Encountered, and so we don't know if there is an easy solution within this framework. So it's not just around the corner. I mean, I've been hearing people for the last 12, 15 years claiming that AGI is just around the corner and being systematically wrong. And I knew they were wrong when they were saying it. I called their bullshit.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Are we going to get systems that can have large amount of associated memory so they can remember stuff? Yeah, but same. It's not going to happen tomorrow. I mean, there is some basic techniques that need to be developed. We have a lot of them, but to get this to work together with full system is another story. Are we going to have systems that can reason and plan perhaps along the lines of objective-driven AI architectures that I described before? Yeah, but before we get this to work, properly it's going to take a while. And before we get all those things to work together, and then on top of this, have systems that can learn hierarchical planning, hierarchical representations, systems that can be configured for a lot of different situations at hand, the way the human brain can. All of this is going to take at least a decade, probably much more, because there are a lot of problems that we're not seeing right now. We have not.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So, first of all, it's not going to be an event. The idea somehow, which is popularized by science fiction and Hollywood, that somehow somebody is going to discover the secret, the secret to AGI or human-level AI or AMI, whatever you want to call it. And then turn on a machine and then we have a GI. That's just not going to happen. It's not going to be an event. Going to be gradual progress Are we going to have systems that can learn from video how the world works and learn good web presentations? Yeah, before we get them to the scale and performance that we observe in humans, it's going to take quite a while. It's not going to happen in one day.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, if you want to make it ubiquitous, yeah, certainly. Because we're going to have to reduce the Compute the power consumption. A GPU today, right, is half a kilowatt to a kilowatt. Human brain is about 25 And the GPU is way below the power of human brain. You need something like 100,000 or a million to match it. So we are off by a huge factor here.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So we certainly need computation. I mean, we're still far in terms of computer power. From what we would need to match the compute power of the human brain, this may occur in the next couple decades, but we're still some ways away. And certainly in terms of power efficiency, we're really far. So a lot of progress to make in hardware. And right now, a lot of progress is not, I mean, there's a bit coming from Silicon technology, but a lot of it coming from architectural innovation and quite a bit coming from more efficient ways of implementing the architectures that have become popular, basically a combination of transformers and convinces, right? So, you know, there's still some ways to go until we're going to saturate. We're going to have to come up with new principles, new fabrication technology, new.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“And then collaboration is also through meta because the lab at Berkeley is associated with meta in some way. So with FAIR. So I think it's very exciting. I think I'm super excited about, I haven't been that excited about the direction of machine learning and AI since 10 years ago when Fairwood started. And before that 30 years ago, we were working on 35 on combination nets and the early days of neural nets. So I'm super excited because I see a path towards potentially human level intelligence with systems that can understand the world, remember plan, reason. Some set of ideas to make progress there that might have a chance to work. And I'm really excited about this. What I like. Is that you know it Somewhat, we get onto a good direction and perhaps succeed before my brain turns to white sauce or before I need to retire.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Gentleman called Danijar Hafner, who is not demind, who's worked on models of this type that learn representations and then use them for planning or learning tasks by reinforcement learning. And a lot of work at Berkeley by Peter Abiel, Sagu Levine, a bunch of other people of that type. I'm collaborating with actually in the context of some grants with my NYU hat.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Of a first step towards training systems for video. And then the next step is going to be world models based on kind of this type of idea, training from video. There's similar work at DeepMind also taking place and also at UC Berkeley on Walmart also video. A lot of people are working on this. I think a lot of good ideas are appearing. My bet is that those systems are going to be JEPA-like and are not going to be generative models. And we'll see what the future will tell. There's really good work at”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Number of things. So there's going to be various versions of Lama that are improvements of previous Lamas, bigger, better, multimodal, things like that. And then in future generations, systems that are capable of planning that really understand how the world works, maybe are trained from video so they have some world model, maybe capable of the type of reasoning and planning I was talking about earlier. Like how long is that going to take? Like when is the research that is going in that direction going to sort of feed into the product line, if you want, of LAMA? I don't know. I can't tell you. And there's a few breakthroughs that we have to basically go through before we can get there. But you'll be able to monitor our progress because we publish our research, right? So last week we published the VJEPA work, which is.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, exactly. A lot of biologists have posted on this actually in response to those things saying, Do you realize how hard it is to actually do the lab work? Like, you know, this is not trivial.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“But it's the same problem. It's difficult to use in situations that doesn't turn against the perpetrators. But we could ask Elon Musk. I can give you a very precise list of instructions of how you build a rocket engine. And even if you have a team of 50 engineers that are really experienced building it, you'll still go to have to blow up a dozen of them before you get one that works. And, you know, it's the same with chemical weapons or biotech weapons or things like this. It requires expertise in the real world that another line is not going to help you with.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source
“So the increasing number of studies on this seems to point to The fact that it doesn't help. So having an LLM doesn't help you Design or built a bioweapon or a chemical weapon if you already have access to a search engine and a library. And so the sort of increased information you get or the ease with which you get it doesn't really help you. That's the first thing. The second thing is it's one thing to have a list of instructions of how to make a chemical weapon, for example, or a bioeapon. It's another thing to actually build it. And it's much harder than you might think, and then NLM will not help you with that. In fact, nobody in the world, not even countries used by OEPs because most of the time they have no idea how to protect their own populations against it. So it's too dangerous, actually, to kind of ever use. And it's in fact banned by international treaties. Chemical weapons is different. It's also banned by treaties.”
2024-03-07 · Lex Fridman Podcast · #416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI · IDENTIFIED FROM THE TRANSCRIPT · source