YouSaid · the spoken record

Jim Keller

lines on the record: 215
first: 2021-02-18
most recent: 2021-02-18
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“AI is, I'm still trying to decide how fundamental this is. It's a given parallelism problem. But the way people describe the neural networks and then how they write them in PyTorch, it makes graphs.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, yeah. So it's interesting. So up until recently, I thought there was two kinds of computers, there are serial computers that run like C programs, and then there's parallel computers. So the way I think about it is, you know, parallel computers have given parallelism. GPUs are great because you have a million pixels. And modern GPUs run a program on every pixel. They call it a shader program, right? Or like finite element analysis, you build something, you know, you make this into little tiny chunks. You give each chunk to a computer. So you're given all these chunks a parallelism like that. But most C programs, you write this linear narrative, and you have to make it go fast. To make a go fast, you predict all the branches, all the data fetches, and you run that more in parallel, but that's found parallelism.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Dumplings are going to be smart, or they're going to be smart enough to talk to something that's really smart. It's like. Just remember, like a big computer chip. Know it's like an inch by an inch, and you know 40 microns thick. It doesn't take very much very many atoms to make a high power computer. And ten thousand of them can fit in the shoebox. You know, you have the cooling and power problems, but people are working on that.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“I think I might have told you this story. A Tesla, they were deciding, so they want to measure the current coming out of the battery, and they decide between putting the resistor in there. Putting a computer with a sensor in there. And the computer was faster than the computer I worked on in 1982. And we chose the computer because it was cheaper than the resistor. So sure, this hedgehog, you know, it costs $13 and we can put an AI that's the smart as you in there for five bucks. It'll have one. So computers will be everywhere.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Science fiction books they call it. Return everything into computing. Well, most of the elements aren't very good for anything. You're not going to make a computer out of iron, like, you know, silicon and carbon have nice structures. We'll see what you can do with the rest of it. People talk about well, maybe we can turn the sun into a computer, but it's hydrogen, a little bit of helium.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Efficient scale. It's scaling faster than an efficiency bites you. And as long as there's dollar value there, like scaling costs lots of money A Google showed, Facebook showed, everybody showed that the scale was where the money was at”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“The scaling by just quantity is probably the richest thing. But then as you scale quantity, like a network that was great on 100 computers, maybe completely the wrong one, you may pick a network that's 10 times slower, on 10,000 computers, like for a computer. But if you go from 100 to 10,000, that's 100 times. So that's one of the things that happened when we did internet scaling is the efficiency went down. Not up. The future of computing is inefficiency, not efficiency.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, that's the slow version. The snail's pace of Moore's Law. Maybe we should trademark that one. Whereas the scaling by number of computers can go much faster. I'm sure at some point Google had, you know, their initial search engine was running on laptop. And at some point they really worked on scaling that, and then they factored the indexer from this piece and this piece and this piece, and they spread the data and more and more things. And they did a dozen innovations. But as they scaled up the number of computers on that, it kept finding new bottlenecks in their software and their schedulers and made them rethink it seems insane to do a scheduler across a thousand computers who schedule parts of it and then send the results to one computer. But if you want to schedule a million searches, that makes perfect sense. So there's”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, there's like half a dozen things going on in that graph. So one is there's initial innovations that had a lot of room to be exploited. So the efficiency of the networks has improved dramatically. And then the decomposability of those, they started running on one computer, then multiple computers, and multiple GPUs, and then arrays of GPUs, and they're up to thousands. And at some point, so it's sort of like they were going from like a single computer application to a thousand computer application. So that's not really a Moore's Law thing. That's an independent vector. How many computers can I put on this problem? Because the computers themselves are getting better on a Moore's law rate, but their ability to go from 1 to 10 to 100 to 1,000 was something and then multiplied by the amount of compute it took to resolve AlexNet to.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Changes in business plans for shipping or something like As long as it's all stress tested, then it keeps adapting to the situation. That's a curious phenomenon.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, that's because it's stress tested all the time. You build all these cities with buildings and you get earthquakes occasionally. Some wars, earthquakes.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Imagine they were really smart and they could comprehend the whole thing. And then they sort of evaluated a human and thought, this is really interesting. No human on this planet comprehends the system they built.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“But it's built on so many components nobody at Twitter even understands. So, if an alien showed up and looked at Twitter, he wouldn't just see Twitter as a beautiful, simple thing that everybody uses, which is really big. You would see the network runs on the fiber optics, the data is transported, the computers, the whole thing is so bloody complicated. Nobody Twitter understands it. And so that's what's”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“We talked about this before. Humans are only so smart, like, and we're not getting any smarter, right? But the complexity of things is going up. A beautiful design can't be bigger than the person doing it. It's just their piece of it. The odds of you doing a really beautiful design of something that's way too hard for you is low, right? It's way too simple for you, it's not that interesting. It's like, well, anybody could do that, but when you get the right match of your expertise in mental power to the right design size, that's cool, but that's not big enough to be. So that the whole thing is big and harmonious, but You know, when you put it together, it's sufficiently interesting to be used. And so that's like a beautiful design is.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“And so good design does that. And you see it in processor designs. When we did the Zen design at AMD, we made several components very modular. And my insistence at the top was I wanted all the interfaces defined before we wrote the RTL for the pieces. One of the verification leads said, if we do this right, I can test the pieces so well independently when we put it together. We won't find all these interaction bugs because the floating point knows how the cache works. And I was a little skeptical, but he was mostly right that the modularity, the design greatly improved the quality.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah. So the famous one was the network stack. Like there's a seven layer network stack, you know, data transport and protocol and all the layers. And the innovation was when they really got that right. Networks before that didn't define those very well. The layers could innovate independently and occasionally the layer boundary, the interface would be upgraded. And that let the design space breathe. You could do something new in layer seven without having to worry about how layer four worked.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yes. And when I say abstraction layer, that means two different components when they work together. They work independently. They don't have to know what the other one is doing.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“It's not I know the Buddha said that, and a couple other people are stuck on it. No, it's, you know, there's this kind of weird combination of good and bad, you know, light and darkness that you have to tolerate and deal with. Yeah, there's definitely lots of suffering in the world.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“When I look back. I think earlier in my career. Like EV5 was the second alpha chip. I was so embarrassed about the mistakes I could barely talk about it. And it was in the Guinness Book of Worlds Records, and it was the fastest processor on the planet. And at some point, I realized that was really a bad mental framework to deal with, like doing something new. We did a bunch of new things and some worked out great and some were bad. We learned a lot from it. Next one we learned a lot. That also EV6 also had some really cool things in it. I think the proportion of good stuff went up, but it had a couple of fatal flaws in it that were painful. And then, yeah.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Again, there's great tension between those. If you haven't Tried hard And done something new. Then you're not going to be facing the challenges when you build it. Then you find out all the problems with it.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, that happens too. Like you have to, because the nice thing about computers, there's always reduction practice. Like you come up with your good ideas. And I know some architects who really love ideas. And then they work on them and they put it on the shelf, then go work on the next idea and put it on the shelf. And they never reduce it to practice. So they find out what's good and bad. Because the moment every time I've done something really new, by the time it's done, Like the good parts are good, but I know all the flaws.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Have you ever brainstormed idea with a couple people that were really smart and you kind of go into it and you don't quite understand it and you're working on it? And then you start talking about it, putting on the whiteboard. Maybe it takes days or weeks. And then your brain starts to kind of synchronize. It's really weird. And like you start to see what each other is thinking. And it starts to work You can see it work. Like my talent and computer design is I can see how computers work in my head like really well. And I know other people can do that too. And when you're working with people that can do that. It is kind of an amazing experience. And then every once in a while you get to that place, and then you find the flaw, which is kind of funny because you can fool yourself.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Idea generation is really funny. So, you have to give your idea space, like spaciousness of mind is key. But you also have to execute programs and get shit done. And then it turns out computer engineering is fun because it takes 100 people to build a computer, 200 to 300, whatever the number is. And people are so variable about temperament and skill sets and stuff that in a big organization, you find that the people who love the perfect ideas and the people that want to get stuffed done yesterday and people like to come up with ideas and people like to shoot down ideas and it takes the whole. It takes a large group of people.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Start thinking about something, and soon as he figure out what was wrong with it, he'd throw it out. And then I start thinking about it. And you come up with an idea, and then you find out what's wrong with it. And then you give it a little time to set because sometimes you figure out how to tweak it, or maybe that idea helps some other idea.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Can't throw out stuff because you can't get it done today. Because maybe you'll get it done tomorrow or the next project. You can't, so you have to, I work with a guy that really like working with, but he over filters his ideas.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“That's creative tension, right So creative tension is you have two different ideas that you can't do both. But the fact that you'll want to do both causes you to go try to solve that problem. That's the creative part. So, if you're building computers, like some people say we have the schedule and anything that doesn't fit in the schedule we can't do, right? And so they throw out the perfect because they have a schedule. I hate Then there's other people to say we need to get this perfectly right, and no matter what, more people, more money, right? And there's a really clear idea about what you want. Some people really go to articulating it. So let's call that the perfect, yeah. All right, but that's also terrible because they never ship anything, you never hit any goals. So now you have your framework.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, it's not that anybody can do anything right now. It's that if you work at it, you can get better at it, and there might not be a limit. They did funny things like he always wanted to play piano, so at the end of his life he started playing the piano when he had Parkinson's. It was terrible. He thought if he really worked out in this life, maybe the next life, he'd be better at it.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, but also the mental agility to understand the whole thing. The pieces in contacts, real view of the balance of how the design worked. Because if you don't understand it properly, when you start to draw it, you'll fill up half the whiteboard with a little piece of it. Your ability to lay it out and understandable way takes a lot of understanding”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Be like, oh, that's this frustrating. And I had this other guy come in one time, he says, Well, I designed a floating point in this chip, but I'd really like to tell you how the whole thing works and then tell you how the floating point works inside. Do you mind if I do that? He covered two whiteboards in like 30 minutes.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Friend told me one time I could draw a computer on the whiteboard faster than anybody you'd ever met, and I said, You should meet my dad. When I was a kid, he'd come home and say, I was driving by this bridge, and I was thinking about it, and he pulled out a piece of paper and he'd draw the whole bridge. He was a mechanical engineer He would just draw the whole thing, and then he would tell me about it and tell me how he would have changed it. And he had this, you know, idea that he could understand and conceive anything. And I just grew up with that. So that was natural. So, you know, like when I interview people, I ask him to draw a picture of something they did on a whiteboard. And it's really interesting. Like some people draw a little box, you know, and then they'll say, and this talks to this.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Parkinson's and then cancer. Last 10 years were tough. And I killed him. Killing a man like that's hard It's pretty good. Parkinson's causes slow dementia and the chemotherapy, I think, accelerated it. But it was like hallucinogenic dementia. So he was clever and funny and interesting and was pretty unusual.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, a lot. I was lucky. He decided I was smart and unusual as a kid and that was okay when I was really young So, when I did poorly in school, I was dyslexic. I didn't read until I was third or fourth grade. And they didn't care. My parents were like, oh, he'll be fine. So I was lucky. That was cool.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Okay, but engineering companies are full of adults who had all kinds of range of childhoods, you know. Most people had okay jobs.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Humans need that. I had a friend, he started a magic group, and he said, I figured it out. You have to praise them before they do anything. I was waiting till they were done. And they're always mad at me. Now I tell them what a great job they're doing while they're doing it. But then you get stuck in that trap because then when they're not doing something, how do you confront these people?”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“So that's why I say it's a feature now. Could you be nicer about it? I don't know. I don't know any good examples of being nicer about it. Well, the funny thing is to get stuff done. You need people who can manage stuff and manage people because humans are complicated. They need lots of care and feeding that you need to tell them they look nice and they're doing good stuff and pat them on the back”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“No, here's the thing once you start moving in the direction of order, the force vector to drive you towards order is unstoppable. In every organization will move to the place where their productivity is stymied by order. So, the question is who's the counter force? Because it also feels really good as you get more organized, then productivity goes up. The organization feels it. They orient it towards it. They hire more people. They got more guys who can run process. You get bigger. And then inevitably, the organization gets captured by the bureaucracy that manages all the processes. And then humans really like that. And so if you just walk into a room and say, guys, love what you're doing. But I need you to have less order If you don't have some force behind that, nothing will happen.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Feature. So there's a graph which is y-axis productivity. And infinity, it's complete order. So as you go from the origin, as you improve order, you improve productivity. At some point, productivity peaks, and then it goes back down again. Too much order, nothing can happen.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“If you have a lot of ideas, like Gordon Bell was famous for ideas, right? And it wasn't that the percentage of good ideas was way higher than anybody else. He had so many ideas, and he was also good at talking to people about it and getting the filters, right? And seeing through stuff. Elon was like, hey, I want to build rockets. So Steve would hire a bunch of rocket guys, and Elon would go read rocket manuals.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, so in Steve, the first round, like he'd go into a lab and look at what's going on and hate it and fire people or ask somebody in the elevator what they're doing for Apple and not be happy. When he came back, my impression was he surrounded himself with a relatively small group of people. Didn't really interact outside of that as much. And then the joke was you see like somebody moving a prototype through the quad with a black blanket over it. And that was because it was secret, you know, partly from Steve because they didn't want Steve to see it until it was ready.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Hardware, software, all of pieces. And then he would have an idea about what could we do with this next that was grounded in reality. It wasn't like he was, you know, just finger painting on the wall and wishing somebody would interpret it. So he had this interesting connection because. No, he wasn't a computer architecture designer, but he had an intuition from the computers we had to what could happen.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“But he used computers. You know, he had computer people talk to him all the time. Like Mike was a really good computer guy. He knew what computers could do.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“And then he was a really good first principles guy. Like somebody say something couldn't be done, and he would just think. That's obviously wrong, right? But, you know Maybe it's hard to do, maybe it's expensive to do. Maybe we need different people. There's like a whole bunch of, you know, if you want to do something hard, maybe it takes time, maybe you have to iterate. There's a whole bunch of things you could think about. But saying it can't be done.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“He said, Hey, fell He was friendly He was wandering around with somebody. He couldn't find the table because the cafeteria was packed and I gave my table. But I worked for Mike Culvert, who talked to, like Mike was the unofficial CTO of Apple and a brilliant guy. And he worked for Steve for 25 years, maybe more. And he talked to Steve multiple times a day. And he was one of the people could put up with Steve's, let's say brilliance and intensity. And Steve really liked him. And Steve trusted Mike to translate the shit he thought up into engineering products at work. And then Mike ran a group called Platform Architecture. And I was in that group. So many times I'd be sitting with Mike on the phone would ring. It'd be Steve and Mike would hold the phone like this because Steve would be yelling about something or other.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“It's the leadership question. Like Apple under Steve Jobs when he came back, they pivoted multiple times. They build iPads and iTunes and phones and tablets and great Macs. Like who knew computers should be made out of aluminum? Nobody knew that. They're great. It's super fun. Yeah, Steve Jobs. Like they pivoted multiple times. And the old Intel, they did that multiple times. They made DRAMs and processors and processes.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, they had lots of people doing lots of different experiments. So they controlled the processor architecture and IP, but they let people put in lots of different chips. And there was a lot of variability in what happened there. Whereas Intel, when they made their mobile, their foray into mobile, they had one team doing one part. So it wasn't 10 experiments. And then their mindset was PC mindset, Microsoft software mindset. And that brought a whole bunch of things along that the mobile world, the embedded world, don't do.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, and architecturally they're really good, but the company itself was fairly insular to what's going on in the industry with cad tools and stuff. And there's this debate about custom design versus synthesis and how do you approach that, I'd say Intel was slow on getting to synthesized processors. ARM came in from the bottom and they generated IP, which went to all kinds of customers. So they had very little say in how the customer implemented their IP. So ARM is super friendly to the synthesis IP environment, whereas Intel said, we're going to make this great client chip or server chip with our own CAD tools, with our own process, with our own other supporting IP and everything only works with our stuff.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Well, there's people who make microcontrollers that are small, but they don't have a fast one. There's people who make fast processors but don't have a medium one or a small one.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Long as it wouldn't. Well, there's the fastest in the environment. For years, you made the fastest one you could, and then people started to have power limits. So then you made the fastest at the right PowerPoint. And then when we started doing multiprocessors, if you could scale your processors more than the other guy, you could be 10% faster on a single thread, but you have more threads. So there's lots of variability. And then ARM. Really explored, like, you know, they have the A series and the R series and the M series, like a family of processors for all these different design points from like unbelievably small and simple. And so then when you're doing the design, it's sort of like this big palette of CPUs. They're the only ones with a credible top to bottom palette.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“Their processor designs were pretty good. I think Core 2 was probably the first one I thought was great. It was a really fast processor and then Haswell was great.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source
“And then they led semiconductor industry. Like they were just a little company, IBM, all kinds of big companies had boatloads of money. And they out innovated everybody.”
2021-02-18 · Lex Fridman Podcast · #162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness · IDENTIFIED FROM THE TRANSCRIPT · source