YouSaid · the spoken record

Mark Papermaster

lines on the record: 38
first: 2024-02-29
most recent: 2024-02-29
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“Thank you both. Like I said, you guys have just done a wonderful job here with no priors and I'm very happy and appreciative that you invited us on and loved the time with you”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Results based on the capabilities and the value we provide, we want to be known over the course of 2024 as the company that really enabled and brought AI across those breadth of applications, yes, in the cloud in those massive LLM training and inference for generative AI, but equally across the entire compute space. And I think this is also the year that that expanded portfolio of applications comes to life. I look at what Microsoft is talking about in terms of the enablement that they're doing of capabilities, cloud to client. And it's incredibly exciting and many, many ISVs that I've talked to are doing the same thing. And frankly, Sarah, they're”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“This for us is a huge year because we have spent so many years developing our hardware and software capabilities for AI. We've just completed AI enabling our entire portfolio, so cloud, edge, our PCs, our embedded devices, our gaming devices. We're enabling our gaming devices to upscale using AI. In 2024 is really a huge deployment year for us. Now is the bedrocks there, the capabilities there. I talked to you about all the partners that we're working with. So 2024 is for us a huge deployment. I think we're often unknown in the AI space. Everyone knows our competitor, but we not only want to be known in the AI space, but based on the”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Has to be the case. I mean, do you want to be in your vehicle that is being driven at a high degree of autonomous driving suddenly get a loss of signal back to the cloud and you just stop because it says, I don't have a signal, you wouldn't stand for that.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Sir, I agree with you. And I think it's one of the next set of challenges, and that is really tackling the idea of not just enabling a high performance and AI applications on the cloud, on the edge, and these end user devices, but thinking about how are they working together synergistically, writing applications that where you don't have that latency, that dependency on a lag in computing, run it on the cloud. It's going to be the most efficient because you're optimizing this massive data center with the most efficient computing. But write the algorithm such that where you do have that need for super low latency, you just need that instance response, have those aspects of the algorithms be at the edge, or in fact on your end user device. And often when you need to react quickly, it just”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Itself that has to really excite you and give you new capabilities. I will mention one thing. I mentioned the AI enablement in PCs. I think it's almost going to make PCs a new category because when you think of the kind of applications that you're going to be able to run with super high performance but low power inferencing you can run, imagine right now if I'm don't speak English at all and I'm watching this podcast let's say it was a lot you know if it's broadcast live and I click my live translation button I could just have it translated to my spoken language with no perceptible delay and that's just one of a myriad of new applications that will be enabled”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“And actually being in our process, if that lags too high, you actually get physically ill wearing that and trying to watch a movie or play a game. So one, I'm very proud of the technology advances that we've been able to make as an industry, and we're certainly very proud of our aspects that we drive from AMD. But the broader question that you've asked is, well, how do you know what's going to be successful? The technology as enabler, but if there's one thing I learned at Apple, the devices are successful really serve a need. I mean, they really give you a capability that you love. It's not just that, oh, it's incremental. I can do this a little better than something else I did before. It's got to be something that you love. And that creates a new category. So it's enabled by technology, but it is the product.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“That's a great question. I'll give you one point. I'll start just with sort of a technological point of view. I mean, I'm proud of the fact that chip design is part of the reason you're seeing all these different type of applications, because you're getting more and more compute capability that has shrunk down and draws such a low power that you can see more and more of these devices that have simply incredible computing and audiovisual capabilities that they can bring to you. I mean, you look at MetaQuest and Vision Pro and things like that. This isn't happening overnight. You look at the earlier versions, they were simply too heavy, too big, not enough computing umph because if the lag between seeing a photon on that screen and on your head mounted device”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“This is a global end stream. We'll create geographic pockets of expertise. So that's how we got to where we are today. But when you have more volatile macro that we're facing today,”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“It goes beyond the foundry. It's the same thing with the packaging. So where do you, as you put those chips onto carriers and you need to interconnect it, you need that ecosystem to have geographic diversity as well. So the way we think about it is it is a matter of importance for everybody to know that there will be geographic diversity and we are heavily engaged. And actually I'm quite pleased with the progress that we're making. It doesn't happen overnight. That's the difference between chip design versus software. Someone can up, you know, with software, you can come up with a new idea and get that product out very, very quickly, get MVP design, get it out there, and it can go viral. But it does take years of prep in expanding the supply chain. The whole semiconductor industry was built up as historically as well.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“You know, you have to think about these things. We are very supportive of working with certainly the U.S. government and other governments across the world, which have exactly that question. How, you know, our country is running now on ship design that powers such essential systems that it becomes a matter of national security to make sure that there will be continuity of supply. And so we build that into our strategy. We build it in with our partners. And so we've been supportive of fab expansion. So you see TSMC building fabs in Arizona. We're partnering with them. You see Samsung building FABs in Texas. But it's not just in the U.S. They're actually expanding as well just a global facilities in Europe and other parts of Asia. And so...”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“We have the building blocks, and we are built on collaboration. It's just such a part of our culture that we don't need to develop the entire system. We don't need to be the ones developing the application stack and the end applications. What we do is partner incredibly deeply and ensure that the solution is optimized end-to-end.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Low power AI acceleration that we have in our PC devices and our embedded devices. So it's about getting tailored engines for the right application, leveraging chiplets that you combine them, put them on what is the best technology node. You want each of those chiplets, each of those functions to be on. And then frankly, holistic design means you've got to keep going right up through the packaging, how you package it together, how you interconnect it, and how you think about the software stack. And so it's literally got the optimization has to be the full circle of transistor design all the way up through the integration of your computing devices and equally with a view of the software stack and applications. And what I'm thrilled about along with all the engineers that I work with at AMD is that we have that opportunity.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“One generation to the next did most of the heavy lifting. So you could just bank on that new semiconductor technology node, shrinking your devices, giving you more performance. It'd have less power and to be at the same cost. So that was what Moore's Law was about. And with Moore's Law slowing, it means you still get those device improvements, but it costs more. Your power is not coming down as much as it used to. are still getting that integration. You're still certainly being able to pack more devices. But it demands more innovation. It demands what I call holistic design. So you're going to rely on those new transition devices, new foundry nodes, but how you use heterogeneous computing, meaning bringing the right compute engine for the right application, a CPU, a GPU, a dedicated engine like we have super.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Now, Sarah, it's a great question. And the reason that I was so attracted to AMD is one, it had a storied history of being a disruptor in the industry. And I certainly felt very strongly that AMD could disrupt with very strong CPU and GPU, but more importantly, putting the pieces together. The idea of chiplets was just coming together. There was early expiration of that around that time. And the engineering team here at AMD, we were able to really get the team rallied in the key leadership rallied around it and drove that innovation. So the reason it's so important is when Moore's Law slows down, the easy way to think about it is it used to be that the chip technology itself, the founder going from”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Were fabulous company, we've been fabulous for coming on 18 years now. And so we've got it down. Hats off to the AMD supply chain team. And I think overall as the industry, you'll hear that generally we're going to move beyond those type of supply constraints. Now, you mentioned power. This is, I think, ultimately going to be certainly a key constraint. And you see all the major operators looking for sources of power. And for us as a developer of the engines which are consuming that power, it brings tremendous focus for energy efficiency and that we can drive into each generation of our design. And we are committed to that certainly, a very top priority.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“We're generally able to meet the supply, or if there's a shortage, it's generally well contained. And so what's happening with AI is, yes, it is clear that we're seeing this massive increase in demand. And the fabs are responding, and you're happening to not think of it just as a wafer fab, but you're absolutely right. It is the packaging. Our cells and our GPU competitor both use advanced packaging. I mean, I'll show you, I know when the camera will come across here, but that is our...”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Supply demand is frankly something that any chip manufacturer has to manage. You have to secure your supply. You look during the pandemic, we had actually a tremendous run on our devices that stretched our supply chain because the demand for PCs went way up. People were working from home. The demand for our X86 servers went way up. And so we were in a scramble mode during the pandemic, and we did very well. We worked, we had shortages of substrates, and we secured more substrate manufacturing capability. We worked closely with our primary wafer foundry supplier, TSMC, we have such a deep partnership with them. We've had it for decades that if we get out ahead of it and we understand the signals, we are”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“bespoke inference application right in a plethora of embedded applications. So with that trend, we're going to see more of that, more tailored compute installations with an attempt to service this ballooning demand.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Application specific configurations you need for your compute cluster and it moving even further, not just from these massive hyperscalers to kind of tier two kind of data centers, but it just keeps on going because when you think about applications which are really bespoke and they can be run on the edge right on your factory floor where very low latency put the inferencing and right at the source of data creation right to end user devices. We've added our AI inference accelerators right onto our PCs. We have been shipping it throughout all of 2023 and actually at CES this year announced already our next generation of AI accelerated PCs. And then of course with our XiLink portfolio across embedded devices we're getting a lot of pull from industry that have”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Nonlinearly, and what we're seeing is a proliferation of people are understanding how they can tailor their models, how they can fine-tune it, how they can have smaller models that don't have to answer any question you have or any application you need to support, but it might be just for your business and your area of exploration. And so that allows a tremendous variety of the size of compute and how you need to configure that cluster. So a rapidly expanding market.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“That's definitely happening. I mean, the supply constraint will go away. We'll be a part of that. We're ramping up and shipping as we speak on our instinct line, and it's going quite well. It's going according to plan. But moreover, to answer your question, I think the way to think about it is that it's just breathtaking how the market's expanding so rapidly. I said earlier that most of the applications today that started on the generative AI with these LLMs, that's been largely cloud-based, and not just cloud-based, but hyperscaler-based because it's such a massive cluster that's required not just for the training, but frankly for quite a bit of that type of generative AI, LLM inferencing also is on these massive clusters. But what's happening now is we're getting application after application that is just taking on.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“In 2022 did nothing more than even deepen that commitment to open source. But Sarah, the point is, we're not about locking in someone with a proprietary wall garden software stack. What we want is we want to win with the best solution and we want or we're committed to open source and we're committed to giving our customers choice. We expect to win having the best solution, but we're not going to lock our customers in. We're going to win on merit, generation in and generation out.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“It's a great question. It's very near and dear to us because we are, as I mentioned, all about collaboration. That's just such a strong part of our culture. And what open source does is it opens up technology to the community. And so if you look at the history of AMD, it's been very focused on open source. Our compiler for our CPUs is LLVM. It's open source. The LLVM is underneath our compilers on our GPU. But more than just the compiler, we've opened up the rock and stack. It is our enabling stack. It was a huge piece in our winning supercomputing with such large installations we have. Why is it our philosophy? And by the way, Xilinx had exactly the same philosophy. And so bringing Xylinks and AMD together.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“So you cannot underestimate that. It tells you that it was a very constrained environment. There was a lack of a competition. It was bad for everybody, by the way, if there's not competition because you really end up with a stagnant industry. You can look at the CPU industry before we brought competitive and leadership. It was really getting stagnant. You were just getting incremental improvements. And so the industry knows that. And we've had tremendous pull and partnership.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Configurations they have. And so they've already been working with customers. And now, as you saw, other people on stage with us at our December event, you can see that we're in there with key hyperscaler, and we're also being sold through many OEM applications. And we're directly working within customers. So there's nothing like that feedback from key customers that are running on your platform to speed us ensuring that we can just be easily deployed and make sure that it's a seamless process.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Thousands and thousands of LLMs, open source LLMs out there on hugging face. While we partnered with Clem and his team, they test as they release any of those language models. They're testing on AMD with our Instinct GPUs equally as they're testing on NVIDIA. So we've really done the same thing as well with PyTorch, where we're one of two qualified offerings on PyTorch. And so all of that testing is being done routinely with the regression testing that's run literally every night on any software release. The other thing that's key is to learn from deployments. And so we've had early engagements like Lamini, who's running on AMD, and they've been offering services of getting on AMD and running your LLMs on their cloud, on their rack.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“And what we've done is ensured that because we're a GPU, it should be easy to deploy. And so really making sure that we leverage the fact that we have all the GPU semantics. So if you're a coder, it's just easy to code if you're using the lower level semantics. But also we support all of the key software libraries that are out there when you think about the kind of frameworks, whether it be PyTorch or a founding member of PyTorch Foundation, whether it be Onyx, whether it be TensorFlow. We are out there very closely working with developers. And so what we've now gone to, now that we have a competitive and leadership offering, is what you'll see is that when you're deploying with AMD very facile, if you're, let's say you're using Huggingface, any of the, you know,”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, you're so right, Sarah. It's multifaceted to be able to compete in this arena. You see many startups going after the space, but the fact is the bulk of Ens Rancin done today is done on general-purpose CPUs, not the huge LLM inferencing, but just general inferencing for AI applications. And then for large language model applications, it's almost all on GPUs because that is the software and developer ecosystems out there. And so we've been competitive on CPUs. We've been gaining at a rapid clip because we've got a very strong CPU generation after generation that we've been releasing on schedules we've laid out for the industry. But for GPU, it did take us until now to develop really world-class hardware and world-class software.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Leads in inferencing. It has over 2x. If you look at FP16, VLLMs, which is a metric that generally everyone can run that, it's got a tremendous performance advantage. And we did that very purposely. We created very efficient engines for the math processing that you need for that training or inference processing. But we also brought the memory that you need to have more efficient computing. So that's more computing at less power, less racks than you need with competition.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Sure. So if you think about where the bulk of AI is today, you're still seeing just tremendous capital expenditures in building up the accuracy of capabilities for large language model, training and inference. So it is the likes of ChatGPT, of BARD and the other LLMs that you can ask it anything because it's trying to ingest the vast of data that is out there and that can be trained upon. And it's with really an ultimate goal of artificial general intelligence, an AGI type of capability. And so that is where we focus the MI300 is to start with that halo product that could take on the industry leader. And in fact, MI300's done that. It's competitive on training.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“We had called the ball on heterogeneous computing before myself, before Lisa ever joined the company AMD had made a great acquisition of ATI that brought GPU into portfolio. It's one of the big reasons I was attracted to AMD and the role is that it was really the only company that had a very strong CPU portfolio and a very strong GPU portfolio. And to me it was clear that the industry needed that powerful combination of the cereal, the scalar competing of these traditional CPU workloads and the massive parallelization that you get from a GPU. And so we started with that heterogeneous compute and created an architecture around that. So we've been shipping CPUs and GPUs combined for PC applications.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“In 2012, through really 2017, it was largely, all of the revenue was based on PCs and then gaming. And so it was about making sure that the portfolio, the building blocks, were competitive. Those building blocks had to be leadership. They had to attract people to get on that AMD platform for high-performance applications. And so first, we actually had to rebuild the CPU roadmap. And that was a Zen microprocessors that we released in 2017 in both PCs with Horizon Line, as well as EPIC, our x86 server line. So that started the revenue ramp for the company and started extending our portfolio. And so right about that time in parallel, as we saw where heterogeneous computing was going.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“We all know the AI journey has been going since really the race began when the application space for AI opened up and GPUs were obviously pivotal there. When you look at the key work that Henton had done in terms of showing how GPUs could drastically improve the accuracy of image recognition, natural language processing. And so that's been known for some time. And so what we did at AMD is we right away saw the opportunity. The question was plotting our course to be that strong player in AI. So it was a very thoughtful and deliberate strategy because AMD, we had to turn around the company. So if you look at where AMD was,”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“The world's largest supercomputers. It's got massive install base now in the clouds, so many of your cloud operations that you're running are running on AMD Epic x86 CPUs. Gaming were huge. We're underneath all the Xbox, all the PlayStation, as well as many gaming devices that you buy when you buy your ad-in boards. And then across embedded devices with all of that rich Xilinx portfolio, as well as embedded x86. And we acquired Pensando, so it extends that portfolio right into a networking interconnect that we need as we scale out these workloads. So very, very broad portfolio.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“So AD is a storied company. It's been around well over 50 years. It started out really being a second source company, really bringing second source on key components in x86 microprocessors. But you fast forward to where we are today. And it's a very, very broad portfolio. When Lisa and Sue, our CEO and I were brought into the company just over 10 years ago, it was with a mandate to get AMD back into very, very strong competitiveness. And so we started with the CPU line, brought the CPU very, very competitive, and then really across the portfolio. And just in February of 2022, acquired Xilink. So that expanded the portfolio further. So AMD created...”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“The big computing chips that we had in mainframe and the big RISC servers. So really got all facets of technology there and included working on some of their server development, but then shifted over to Apple. Steve Jobs hired me to run the iPhone and iPod. And so I was there for a couple years. a time of a great transition in the industry and for me it was a great opportunity because I ended up in 2011 fall 2011 taking the role here at AMD of being both CTO and really running the technology and engineering and right at a point where Moore's laws starting to slow down and so you know tremendous innovation was needed”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT
“Well, sure. I've been around a while. So, what's really fun is my timing was pretty good getting into the industry as an electrical and computer engineering grad, University of Texas, and got really interested in chip design. And so it was back at a time when chip design was radically changing, the kind of technology everyone uses today, CMOS, was just coming into production usage. And so I got on IBM's very first CMOS projects and created some of the first design. So I got to get my hands dirty and do just about every facet of chip design and had a number of years at IBM and took on different roles, took on driving the microprocessor development at IBM across first their power PCs and that meant working with Apple and Motorola as well as the big iron.”
2024-02-29 · No Priors · Competition makes for better chip design with AMD CTO Mark Papermaster · IDENTIFIED FROM THE TRANSCRIPT