YouSaid · the spoken record

Mark Zuckerberg

lines on the record
172
first
2023-06-08
most recent
2023-06-08
sittings or episodes
1
sources
podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

  1. I think it's been really neat to see. I mean, there's been folks who are getting it to run on local devices, right? So if you're an individual who just wants to experiment with this at home, you probably don't have a large budget to get access to a large amount of cloud compute. So getting it to run on your local laptop is pretty good, right? And pretty relevant. And then there were things like Llama CPP re-implemented it more efficiently. So now even when we run our own versions of it, we can do it on way less compute and it just way more efficient, save a lot of money for everyone who uses this. So that is good.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  2. It's also how we've done a lot of our infrastructure, and we took our whole data center design and our server design, and we built this open compute project where we just made that public. Part of the theory was like, all right, if we make it so that more people can use this server design, then that'll enable more innovation. It'll also make the server design more efficient. And that'll make our business more efficient too. So that's worked. And we've just done this with a lot of our infrastructure.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  3. It would be good if there were a lot of different folks who had the ability to build state-of-the-art technology here. And not just a small number of big companies. To train one of these AI models, the state-of-the-art models is just takes hundreds of millions of dollars of infrastructure, right? So there are not that many organizations in the world that can do that at the biggest scale today. And now it gets more efficient every day. So I do think that that will be available to more folks over time. But I just think there's all this innovation out there that people can create. And I just think that will also learn a lot by seeing what the whole community of students and hackers and startups. And different folks build with this. And that's kind of been how we've approached this.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  4. We're working on the follow up models for this and thinking through how exactly this should work for follow-on now that we've had time to work on a lot more of the safety and the pieces around that. But overall, I mean, this is. I just kind of think that.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  5. And part of our ethos is that we want to share what's invented broadly. We do that with a lot of the different AI tools that we create. And LAMA is the language model that our research team made. And we did a limited open source release for it, which was intended for researchers to be able to use it. responsibility and getting safety right on these is very important. So we didn't think that for the first one there were a bunch of questions around whether we should be releasing this commercially. So we kind of punted on that for V1 of Lama and just released it from research. Now obviously by releasing it for research, it's out there, but companies know that they're not supposed to kind of put it into commercial releases.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  6. Yeah, sure. I think you're right, first of all, that in the last year there have been a bunch of advances on scaling up these large transformer models. So there's the language equivalent of it with large language models, the sort of the image generation equivalent with these large diffusion models. There's a lot of fundamental research that's gone into this. Meta has taken the approach of being quite open and academic in our development of AI. Part of this is we want to have the best people in the world researching this and a lot of the best people want to know that they're going to be able to share their work. So that's part of the deal that we have is that we can get if you're one of the top AI researchers in the world and come here, you can get access to kind of industry scale infrastructure.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  7. Important life lessons, right? It's like, okay, you're surfing a wave. It's like. Sometimes you can't go in the other direction on it, right? It's like there are limits to kind of what, you know, it's like a foil. You can pump the foil and push pretty hard in a bunch of directions. But like, yeah, at some level, like the momentum against you is strong enough. That's not going to work. And I do think that that's sort of a humbling, but also an important lesson for And I think people who are running things or building things. It's like, yeah, you know, a lot of the game is just being able to kind of push and work through complicated things, but you also need to kind of have enough of an understanding of which things you just can't push through and where the finesse is more important.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  8. You can't push through everything That You learn this stuff very acutely doing sports compared to running a company because running a company, the cycle times are so long, right? It's like you start a project and then it's like months later. Or if you're building hardware, it could be years later before you're actually getting feedback and able to make the next set of decisions for the next version of the thing that you're doing. Whereas one of the things that I just think is mentally so nice about these very high turnaround conditioning sports, things like that is you get feedback very quickly, right? It's like, okay, like I don't counter something correctly, you get punched in the face, right? So not in jiu-jitsu. You don't get punched in jiu-jitsu, but in MMA. There are all these analogies between all these things that I think actually hold that are like,

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  9. One of One of, I don't know, my experiences that I think kind of transcends running a company in the different Different activities that I like doing, I really believe that if you're going to accomplish whatever anything, a lot of it is just being willing to push through and having the grit and determination to push through difficult situations. I think for a lot of people that ends up being sort of a difference maker between the people who kind of get the most done and not. I mean, there's all these questions about how many days people want to work and things like that. I think almost all the people who start successful companies or things like that are just are working extremely hard. But I think one of the things that you learn both by doing this over time or very acutely with things like jiu-jitsu or surfing is

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  10. I just think you have to be willing to. Just get beaten up a lot. But I mean, over time, I think that there's a flow to all these things.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  11. My style is I'm probably more pressure and yeah I'd probably rather be the top player but I'm also smaller right I'm not I'm not like a heavyweight guy right so from that perspective I think it's especially because you know from doing a competition I'll compete with people who are my size but a lot of my friends are bigger than me so back takes probably pretty important right because that's where you have the most leverage advantage right where where people you know their arms your arms are very weak behind you right so so being able to get to the back and and take that pretty pretty important but I don't know I feel like the right strategy is to not be too committed to any single submission but that said I don't like hurting people so so I always think that chokes are are a somewhat more humane way to go than joint locks

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  12. It's got the lapels. Yeah. So I like Jiu-Jitsu. I also And so I think No Gi more closely approximates MMA. And I think my style is maybe a little closer to an MMA style. So like a lot of jiu-jitsu players are fine being on their back, right? And obviously having a good guard is a critical part of jiu-jitsu. But in MMA, you don't want to be on your back, right? Because even if you have control, you're just taking punches while you're on your back. So that's no good.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  13. Policy issue. There's like a new technology that's developing here. We're having an issue with this partner. There's a design trade-off and WhatsApp between two things that end up being values that we care about deeply and we need to kind of decide where we want to be on that. And I just think over time when by working through a lot of issues with people and doing it openly, people develop an intuition for each other and a bond in camaraderie. And to me, developing that is like a lot of the fun part of running a company or doing anything, right? I think it's like having people who are kind of along on the journey that you feel like you're doing it with, nothing is ever just one person doing it.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  14. Yeah, I mean, I think for one thing, it's just spending a lot of time with whatever the group is that you want to be that core group grappling with all of the biggest challenges. And that requires a fair amount of openness. And a lot of how I run the company is, you know, it's like every Monday morning we get our, it's about the top 30 people together and we, and this is a group that just worked together for a long period of time. And I mean, people rotate in. I mean, new people join, people leave the company, people go do other roles in the company. So it's not the same group over time. But we spend a lot of times a couple of hours, a lot of the time it's can be somewhat unstructured. I'll come with maybe a few topics that are top of mind for me, but I'll ask other people to bring things and people raise questions, whether it's, okay, there's an issue happening in some country with some.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  15. I mean, we're like a very people focused company, and it's the people is the part of it that weighs on me the most to make sure that we get right. But yeah, that I'd say across everything that we do is probably the big thing.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  16. Can make hard decisions and push really hard to do the best work, even in kind of optimize something super well. But when there's that tension, I mean, that's when things get really tough. And when I talk to other friends who run other companies and things like that, I think one of the things that I actually spend a disproportionate amount of time on in running this company is just fostering a pretty tight core group of people who are running the company with me. And that to me is kind of the thing that both makes it fun, right? Having friends and people you've worked with for a while and new people and new perspectives, but like a pretty tight group who can who you can go work on some of these crazy things with. But to me, that's also the most stressful thing is when there's tension, that weighs on me. I think it's maybe not surprising.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  17. The thing that stresses me out the most is always the people challenges. I kind of think that strategy questions, I tend to have enough conviction around the values of what we're trying to do and what I think matters and what I want our company to stand for, that those don't really keep me up at night that much. I mean, I kind of, you know, it's not that I get everything right. Of course I don't, right? I mean, we make a lot of mistakes. But I at least have a pretty strong sense of where I want us to go on that. The thing in running a company for almost 20 years now, one of the things that's been pretty clear is when you have a team that's cohesive, you can get almost anything done. And you can run through super hard challenges.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  18. Your ability to keep doing interesting things is your willingness to be embarrassed again and go back to step one and start as a beginner and get your ass kicked and look stupid doing things. And I think so many of the things that we're doing, whether it's this, I mean, this is just like a kind of a physical part of my life, but at running the company, it's like we just take on new adventures. all the big things that we're doing i think of as like 10 plus year missions that we're on where you know often early on you know people doubt that we're going to be able to do it and the initial work seems kind of silly and our whole ethos is we don't want to wait until something is perfect to put it out there we want to get it out quickly and get feedback on it and so i don't know i mean there's probably just something about how i approach things in there but i i just kind of think that the moment that you decide that you're going to be too embarrassed to try

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  19. I do think that there's a thing where as people grow up, maybe they don't want to be embarrassed or anything. They've built their adult identity and they kind of have a sense of who they They are and what they want to project. And I don't know. I think maybe to some degree

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  20. Right. So, I mean, the main thing, like people who train jujitsu, it's like you need to not have pride because, I mean, all the stuff that you were talking about before about Getting choked or getting a joint lock, you only get into a bad situation if you're not willing to tap once you've already lost, right? But obviously when you're getting started with something, you're not going to be an expert at it immediately. So you just need to be willing to go with that. But I think this is like, I don't know. I mean, maybe I've just been embarrassed enough times in my life.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  21. It's 100% focused to compete. I needed to get around the fact that I didn't want it to be like this big thing. So I basically just rolled up with a hat and sunglasses and I was wearing a COVID mask. And I registered under my first and middle name, so Mark Elliott. And it wasn't until I actually pulled all that stuff off right before I got on the mat that I think people knew as me. So it was pretty low key.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source

  22. It was fun. I don't know. Yeah, I mean, we'll look. I'm a pretty competitive person. Doing sports that basically require your full attention, I think, is really important to my mental health and the way I just stay focused at doing everything I'm doing. I decided to get into martial arts. And it's awesome. I got like a ton of my friends into it. We all train together. We have like a mini academy in my garage. And I guess one of my friends was like, hey, we should go do a tournament. I was like, okay, yeah, let's do it. I'm not going to shy away from a challenge like that. So yeah, but it was awesome. It was just a lot of fun.

    2023-06-08 · Lex Fridman Podcast · #383 – Mark Zuckerberg: Future of AI at Meta, Facebook, Instagram, and WhatsApp · IDENTIFIED FROM THE TRANSCRIPT · source