YouSaid · the spoken record

Sarah Guo

lines on the record
87
first
2024-08-06
most recent
2024-08-06
sittings or episodes
1
sources
podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

  1. “Very quickly, I'm going to open my world to you. I think that's an amazing thing to do for somebody. And in terms of giving the people that I work with opportunity, may we try to be like that.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  2. “Personal confidence. One more sentence about this. If you could be productive for, I think Sheen was actually a little bit skeptical of me when I came in, which is totally okay, right? Trust is earned. But he became a really big sponsor for me. The attribute I tried to emulate is give your people as much and perhaps a little too much opportunity if they prove they can take it. When I say confidence, he was incredibly open with his network. He was incredibly meritocratic where I don't mean to be cynical about this, but there are many people who would have been like, I'm investing in enterprise security. And you as a 24-year-old really young looking girl from no particular interesting, accomplished startup background, yes, we're going to go do all of this company building work together and I'm going to take your judgments very seriously.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  3. “Working together for a small amount of time, like having complete conviction. And I did too, but you have potential. We don't know what we're going to do with you. Just come work here. And so it was like raw goods bet of an opportunity where I'm like, I haven't done anything interesting in the technology world. I am a kid from Wisconsin who was working in banking who happened to work on your IPO. And it just takes like a certain conviction in your own judge of talent for somebody to be like, oh, come work here went on paper. Who cares about your profile? I'll forever be very appreciative to Anil for that. My former partner, Ashim Chandna, is legendary enterprise in particular security investor. But one of the things that I seek to emulate in Ashim is his ability to work with earlier career investors really comes from a place of amazing”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  4. “There's too many to answer here. I'm very grateful for the number of people that have given me opportunity is not an acceptable answer. I'm going to name three people. The first is, I mean, you have my husband Pat on the podcast. He's my favorite person in the world. I'm like, oh, thanks for asking me to marry you. Like, that's great, right? I just appreciate that. Got very lucky. And then I'd say two people that I will be eternally grateful to for different reasons. One is Anil Bussery, who used to be a partner, leader at Greylock, and was the founder of Workday, an amazing technologist, where I think in Anil's view, he was like rescuing me from finance at Goldman, who's ah, at one point, like I was at Morgan Stanley and you like belong back in technology. And I'm like, I know, like, I'm a technologist. I'm just here learning about the business side for a year. And I'm like, I'm going to go work at Stripe or something. But the thing that Anil did for me was just saying,”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  5. “Walked away convinced that we'd go to work for them, and they're kind of like, oh, people are surprised. It's like why you're trying so hard when you don't have to. And I'm like, oh, anybody in technology, like above subsistence level, what does have to mean? It's like the funniest observation to me. I guess my reaction to that is, of course, I have to. What else am I going to do? Let the world pass me by be number four. Maybe they mean it like financially. Oh, like does the money really matter? I'm like, no, but it's really fun to be right, go compete, work with great people. The discovery for me is maybe this resonates with you. The motivation of working with the most interesting and motivated and high leveraged people in the world and helping them be a little bit more successful and being right about that over a long period of time. Of course you have to.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  6. “In a neural network, and then training the program from the data set. This is like quite a lot of work to do from scratch. I genuinely think of this era as a new era of software. We are manipulating models of different kinds where a bunch of the work has been done for us. The foundation models are so capable. And if you can build intelligent systems to do increasingly useful work, how could you not want to work on leverage these superpowers in every domain? Maybe do it better than humans in areas that really matter, healthcare and science, but also in daily work and taking the operational toil out of every industry. And so it's just really interesting. It's an ambitious era. I think that's super exciting from a personality perspective. We had some founders doing references on us in investment.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  7. “This is the most important change to happen in technology in our lifetimes. And so if you believe the impact is very large, not in like a religious AGI way, but if you just think the opportunity for productivity and abundance is very large and you can create new economic platform players and the landscape is so open because your opinion actually really matters now versus if you were investing in SaaS like you and I were in like 2015 there were incremental discoveries and understandings about companies and technology that did matter. I'm not trivializing that, but it was at a very different scale. If software 1.0 was about human engineers writing explicit instructions and source code, and that was decades. And then Andre Carpathi wrote a essay about software 2.0 being like replicating and finding in search space a specific behavior from a data set.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  8. “A lot of people in AI don't believe in this idea anyway. One theory of it would be Patrick with a model can come up with better answers than Patrick or the model that will be the bar for human eval for the next set of models, but that's a version of it. But it's an interesting question. How do we continue to evaluate models as models progress, understanding the different theories on reasoning traces leading to model self-improvement?”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  9. “One version of it, I think another example of an idea is have you ever heard of the term Centaur play? If you play chess,”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  10. “Comparison of generalization of multi-step reasoning, I think, is an interesting area. A open question is we have all of these benchmarks exams at humans in different domains take, MMLU or a legal exam, a medical exam, et cetera. We are surpassing the benchmarks in a bunch of different ways where it begins to open the question of how do we do evaluation of these models as they are super intelligent, not in any super philosophical sense of the word, but only in the sense that they are better than our human experts at a particular task. And so human eval becomes hard. How do we understand progress as we go from there?”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  11. “Three domains that I think are interesting. I can't choose one, but one is the problem is nobody's going to write this research paper because it's all like proprietary knowledge.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  12. “Some sort of modularity or that efficiency of training matters in a way it hasn't in the past. Because that is when you start talking about the multi-billion dollar training run that gets you to state of the art for some period of time. It's a hard CapEx investment.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  13. “Think a point of change now that's kind of interesting is at the scale of clusters required for the next generation of training, these are for training essentially like single use gigantic constructions of CapEx. And they're not easily extensible to the next generation. Obviously, you can use those for trading smaller models, experimentation, inference, whatever. But the idea that we're just going to build larger and larger data centers consuming more and more power in order to improve model performance feels like it has some limits and it probably goes back to the discussion we were having before of efficiency has always mattered. And maybe there is increasing investment in”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  14. “A dead end because we cannot do this with the rest of, think about the qualitative reasoning that you do on an investment. There's no proof. That's one open question of are there more general answers to improving multi-step reasoning that are not in a particular domain? Because some people will look at code and maths and extension of RL and games. And is that the right path forward? I think lots of people are interested in it. It's like much less clear consensus in the research efforts than more scale, more data, human expert data, and better quality of data improvement of the quality in the pre-training as well.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  15. “Labs and upstarts. I will describe one directional effort that people are investing in, which is, I just had Oriol vineyols from DeepMind on our podcast to talk about this, but does it make sense to invest in math and computer science as a domain where it feels closer to pure logic you are doing multi-step reasoning and in terms of improving model capability specifically against this domain and using generated data in this domain as new training data for the model lots of people are doing this there's a contingent of folks that say that is not a general approach human reasoning is much richer than that and so looking at code or looking at math translating problems into lean and verifying them that's to some degree”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  16. “This is a little bit in the weeds, but I think the debate about how you improve multi-step reasoning in a general way is open question on the labs. And this is like a very fundamental question of where does the next step function of intelligence come from beyond just scaling? Because on both a compute and a data side, that is more difficult than it was in the last generation. People have varied points of view on this in the different labs.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  17. “But I think those are quite large. I'm more oriented toward, wow, we have like a lot of abuse that's happening already with older technologies that just gets so much more amplified, gets much cheaper with leverage of this generation of models and improving capabilities. We should address that pretty immediately and in a sophisticated way.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  18. “Things that are interesting to be afraid of biorisk, runaway model that is optimizing paperclip production, China weapons system or something. I think we should go figure out if those risks are real, but I actually think they're like a huge distraction from the near-term abuses. And so for you and I, investors in technology, technologists themselves, the ability to adapt to new tech is a built skill, but it will not be true across the entire world that people adapt very quickly. And so there are some incredibly basic abuses where I would be excited about solutions. And it's very easy to say misinformation and fraud.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  19. “It's true when you look at some of the most interesting application layer companies today, they may not frame themselves this way or even be consumed this way. And that might be the difference, what we're talking about is consumed as a services experience. But they're replacing things that were services before.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  20. “The answer is yes, but what would get me jumping out of my seat excited would just be somebody with the relentless ambition to figure out if we can make the margins as good as a software business. And let's think less about margins, more about scalability because you could be like, okay, fine. Why are services businesses lame? Well, because you're fighting on human capital quality and volume. You can only scale so fast. You can only get valued X multiple in the public markets eventually because it is only so profitable. And hey, like to some degree, because you can't really tell it's a brand game in the end. Go with a big consulting firm. Those are some of the reasons people don't like services businesses. And so for a story I could believe around scalability and ambition of scalability and all the things that come out of it, like how much of it is a technology business? Yes, the answer is high enough. Yes.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  21. “Who's writing configurations of this platform? It's so far away. But if you think about the economic value and what technology is actually super important to the largest companies in the world that they feel like they can do nothing about or they can't improve, that's kind of it. That's to me the type of underexploited opportunity where the domain is so far away from the technologists. Even that's still software. Never mind healthcare operations or government administration or call center operations or something like that. And so I think they're in Lara's a little bit of the opportunity. Another one that we're just really excited about in terms of potential value for society and clearly the data set is not generated and owned at the large labs today is material science as a domain for foundation models. But if you ask me like, why doesn't that exist yet? Well, I think you need to have the right talent.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  22. “In code generation, I think some of these tasks are pretty tenable, or you could at least create a services org that has a very different margin structure than today's orgs. Better margin structure, better SLA, better end user experience, maybe change the industry structure of software because this configuration and maintenance and depth of embedding in a particular enterprise system is the thing that makes it so sticky. the fact that you configured SAP 20 years ago, it's just all your business process you couldn't possibly get out of it. If you could replicate in a different system, that's a very high mountain decline, but pieces of that could change the industry of software, enterprise software. That's really interesting. But if you think about all of that work, that type of software engineering work that's considered very low status work in Silicon Valley engineering circles, what's happening over there?”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  23. “What does the legal workflow look like? That's not part of their life experience. And so one of the really interesting opportunities that we think about and actually do support incubation around is places where the context of what people are doing that could be automated or improved is so far away from the engineering and research community that understands the capability at the state of the art today. So an example would be there are many billions of dollars spent a year on configuration, monitoring and maintenance of enterprise software systems, ERP, HR, CRM, workflow systems like ServiceNow. That gets done by large consulting shops in the US, in India. And I think if you asked, if we look at the capabilities that are coming in software generation,”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  24. “Describe two opportunities that I'm excited about, and one of them I know why it doesn't exist yet, even though it's so big. The vast majority of the time, incubating companies is a terrible idea because my foreign partner, Jerry, used to say there's no such thing as inception. People like have to live the problem and the ideas and go after and make it their own entrepreneurs that we want to back. They have the agency to go do it. But one of the places where I think this is not true is where essentially the context and capability to build a particular type of company rarely come together. This is one of the things that is so powerful about Harvey. How many times do you get somebody who is going to be entrepreneur and forward thinking about workflow that they are a lawyer working 90 hours a week at a good firm and are still like, can I make chat GPT do my job? And then his roommate is a great researcher. It's uncommon because you ask your average researcher at a lab.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  25. “Timeline, I'd say the things that I can picture very clearly is the ability to learn and express a capability that would Your expectations around creativity of entertainment. Everybody has desktop Pixar. Everybody has the world's knowledge in the form that is most useful to them immediately. Andre's working on this educational tutor thing. Somebody can become an expert in something at an incredibly accelerated rate because of that. There are a bunch of areas that should market structures be willing buying processes, be willing magnitude of improvement being enough become a lot more efficient. So I don't think I have a clear version of the future. I can picture a lot of really amazing individual experiences.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  26. “I think they're going to be a lot more intelligent and creative. So 2030 is really hard because I can't assign a probability to it, but there is a piece of me that says real probability of abundance. I don't know if we're all sitting on a beach partying in Europe or something. But I say that like a little bit glibly because the ability of society to ingest that much change in productivity is not great. There will be winners and losers and the job displacement dynamic, I think, is real. I also think it's probably not quite as fast as people are worried about. So I'm splitting my mind between, okay, model progression happens very, very fast. And we solve a bunch of really important problems. And we have abundance. If I take a step back from that in terms of just optimism of time.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  27. “At OpenAI and Anthropic and others, it's the great game. It's really interesting. Of course, like you and I are interested in that too. But when the entry price is now more than half a billion dollars to do pre-training of something interesting or at least get into the game of a general language model, that's a really easy way to lose money.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  28. “General foundation models. Maybe that's obvious. That's a way to lose a lot of money. I would also say as somebody who wants, I do think that there will be multiple players at the chips and systems layer. And Chip Systems networking, the new data center layer, the opportunity is too large. Capitalism works. It will happen. It's just barriers are high. I don't think that the market is not infinitely deep for another LLM player that isn't particularly differentiated but is just a handful of great researchers working on something that feels very general or feels directly in the path of the existing large players. And so I would say companies keep getting funded that are of this shape because people look at and are envious of the value.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  29. “Oh my goodness. Of course, I have a bubble hat. We have skin in the game. I'm a large owner in my own fund, and this is the main thing. If the promise I made to LPs was multiple, we got to go make good on that. I think most people should not be training.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  30. “Then, if you look at, for example, Google and their chip efforts, those work actually, because Google has the workloads where they're training on their own chips at scale. And I would ask you, do we know that the other chip efforts are working? You either need the patient zero or that patient zero to be yourself because it is a very hard thing to answer without that workload. Doing it physically is really expensive because then you need to go deploy 10,000. Maybe that's just an interesting anecdote where we've been thinking a lot about is there opportunity here and what are the barriers and love and respect for Jensen and Nvidia, spending time with him as well. I think the barriers are pretty high.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  31. “Hard for people to attack if you don't have people running large scale training workloads at multi-thousand node cluster size on your chips, you do not know if they are going to work. And so this isn't something that you can do as easily. Okay, we're going to do test and simulation, test in FPGA, and then like we have as much confidence as we can that chip will tape out, Chip fits the spec. It is useful. The types of failures that can happen in large-scale training, which is a huge driver of consumption that a lot of people are going after, it seems to, at least with some of the new contenders, only come out at scale. And so that's a really difficult risk to mitigate where I'm like, I don't know, can you do that in sim? Because it's a new problem. I think that's kind of interesting because”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  32. “Chip and so you have Grock and cerebrus and etched and Maddox and whatever else. I would love to see most of the industry that isn't a giant holder of NVIDIA, but even some of those would love to see more innovation at this layer. People understand the power of CUDA and the optimization and effort that's been going into that for more than a decade and a half. One of the core challenges that people don't recognize is We had a portfolio company who used a different chip, not NVIDIA GPUs, to try and train a large scale model. These are X-Large Lab researchers who know what they are doing and no way and saying that the engineering and infrastructure management work that they did was perfect, but it exposed me to an understanding of what is making this problem so.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  33. “Claim one thing that's maybe interesting to a broad investing audience like you have, there are a lot of people thinking about why is there not a legitimate challenger to NVIDIA? And what are all of the structural advantages that NVIDIA has? And broadly, basic analysis of the landscape would land you at, okay, AMD is working on this and their software stack has not been competitive to date, but maybe they're getting closer software and hardware, but weakness in the software stack. Then you have a series of proprietary chip efforts, sometimes from acquired companies at Microsoft, Amazon, Google, rumored now opening eye. And then you have upstarts who are trying to do either systems with a particular DGX boxes, like more like a mini data center than a chip, but either like a full system or a”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  34. “I'm on the board of this company called Base 10. You want to do inference on GPUs of different types that is serverless and not write all of your own scheduling and GPU failure management and whatever else. You can do that. And then there are people working on everything from memory bandwidth to chips to systems. The entire ecosystem has innovation that we expect to as an industry reap the benefits of over the next five or ten years. There's no reason to me that won't happen. I can't predict how quickly the cost. I think it will still feel like you always need more. Think about progression of PCs. You always want a latest processor. But I am not worried that the end margin structure of any application company is bad or any worse in this era. It's not clear to me that that's a structural problem versus the software era.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  35. “Resources in this super immature ecosystem. Think about the amount of compute that we have accessible in our phones when a huge ecosystem is focused on the efficiency of getting more and more power into our hands here in any other machine. Could we use as an ecosystem more competition to NVIDIA? Yes, this stuff will get cheaper if there are multiple players. I mean, NVIDIA is innovating pretty fast, but pushing NVIDIA and then eventually challenging a 90% margin product. But overall, I expect the industry to get much, much better at hardware utilization and at efficiency in a bunch of different ways at every layer of the stack. And so when I think about the OPEX of OpenAI as an example, but any other application company, the optimizations that a company itself can do then in infrastructure management.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  36. “And you put your server there. And then you had hosted renting server and the data center from somebody. And maybe they're even running an application for you. And then you had virtualization. I'm renting an instance. And the kitties, I graduate from computer science programs now. If they're not thinking about AI, serverless, I don't want to know that there's hardware behind that. Click button, Amazon, Google, infinite capacity. In AI, we're like step one or two. You are building and deploying your own clusters in data centers. You are in three-year reservation mode. You're managing your own depreciation cycle. And you're like, oh no, our B100s from NVIDIA are going to totally destroy the amortization schedule on this. I don't know. That's a really hard environment to innovate in. And so power to the labs and every company inside, outside our portfolio that thinks about it because they're training on large.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  37. “We just had a conversation about how efficiency matters will matter more and more. I am not particularly concerned about OpenAI's OpEx. The wins behind them, not that they shouldn't care, but I am not concerned that this is like an existential thing for them where ChatGPT can never be a good business. It depends on whether or not ChatGPT is like a differentiated product in market, but the wins behind them look like the rest of computing investing in efficiency against these workloads. And so we're super early. Right now, we're in this crazy, immature part of the infrastructure cycle. So let me like say a little bit more about that. Look at the history of where'd you get a server for, let's say, a client server application, a web application. You had it on-prem and then you co-located it. Somebody gave you like power and real estate and cooling.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  38. “Model quality. And so I just think the dimensions on which people optimize change over time, I'm very loath to make any prediction, but I think it's going to be a rich ecosystem. And I'm hopeful of that.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  39. “Work in a compute for a long time as an industry, and it is not so cheap that nobody cares because we just keep doing more with it. There is no company that isn't like, oh, if compute resources were free, similarly, we'll look at this and be like, if intelligence resources were free, we wouldn't do more, but they're not free. I do think efficiency, especially if we start getting to the next generation scale of models, even limits to data center size and power thinking about using the resources that we have well, both in training and in inference for every particular application problem is just going to become a much bigger consideration. You see it now. A year and a half ago, I'd say focus on data quality wasn't considered the highest status part of research. People care a lot about it now because we were run up against some limit, which is, well, we took the internet data and improved quality is going to lead to improved.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  40. “Company can absorb it for a very long time if they've got like a great other business model like ChatGPT, Facebook, Google. But in a vacuum, more efficiency is better for latency and cost and scalability reasons. And so one big potential change in the ecosystem is whether or not people are going to start using a mix of distilled models models of different scales, putting them in compound AI systems and getting to performance and efficiency. And so efficiency was not a huge consideration amongst research labs and application companies until relatively recently. But I'm sure you've heard this term towards intelligence too cheap to meter. And I will make you a claim that there's no such thing as cheap enough.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  41. “Going back to the description of the ecosystem that I think is great for innovation and great for the end user, it is one of faster, more democratized progress and economic value at multiple layers in the stack. And I think that is Mistrawl's view of the world. Arthur and Gam and Timothy are amazing researchers with a bent toward both state-of-the-art performance, but also a view on efficiency. And again, going back to blindly believing some dominant narrative in the AI landscape is very dangerous. There was a narrative. Maybe it still exists. I don't know, that efficiency doesn't matter. Model efficiency doesn't matter. It doesn't matter how expensive it is to run or how big it is. You just want the best performance. And nowhere in the history of computing has efficiency not mattered because somebody is paying for it in the end. And so maybe the model.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  42. “Modern hardware as you get to not train all of the intermediate models and just try to be at the state of the art with the state of the art techniques. It is a competitive market. The commitment of Zuck to that market. Some challenge believing that Facebook is going to be a great long term partner to them. But the more they work with the ecosystem of deployment and inference and consulting partners, the more credible it is. And a rich and competitive ecosystem of models means that there's not total rent collection at that layer and lots of opportunity for many companies to walk that last mile.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  43. “And so it's very hard for me to imagine a single company or two or three walking that mile, essentially. And so what I would like to see is you have these amazing assets, you have multiple options, you have open source. And there is enough choice and competition and robustness at this layer that you can have companies built with true economic value on top and in partnership with them. I think that will happen. The alternative point of view is that the race for development gets increasingly expensive. I mean, that's going to happen anyway, but like that it becomes harder and harder for people to keep up. But an interesting dynamic here is the number of people who know how to train large models is increasing. And the second comer discount is very high as that expertise is known as you get to use.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  44. “We work closely with all the large providers, and that means take our portfolio over to see the foundation model companies, make sure they have research connectivity, co-invest with them. And we are also first round investors in Mistraw. I'm very loath to make predictions here because AI is just really hard. Anybody who really says that they know what is coming more than six months from now that doesn't need a large lab is likely. And even so is I think the large labs were quite surprised by the success of open source over the last year. And so when you say like, what do I hope for? I want a million flowers to bloom because the last mile to humans with more joy and play and productivity in every corner of the economy and every part of the globe, that last mile is really long and there's a lot of them.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  45. “The types of businesses and the types of functions that had the most inefficiency can be most ripe for selling new solutions.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  46. “Much to unlock there because the number of people employed and the number of hours wasted that in the administration of healthcare in the United States that causes a good deal of why our healthcare is so expensive is really high. If you ask me about another area that I wasn't excited about in terms of investing in, but generally, please still call me, especially now, but might be as the models get better is government services. These are all huge parts of the economy that are incredibly inefficient where people are doing analysis and moving data around the workflows you can picture in a way that make a ton of sense to apply these model capabilities against creatively. Like as maybe my fundamental optimism comes from this place of, well, if we make it a hundred times cheaper, no matter how complicated that ecosystem is, I think we can sell it. That's one thing that we've begun to see. And the leapfrog effect is.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  47. “AI thing is making me personally rethink a number of my assumptions that were long held as an investor, but we may be surprised. I think we're going to get some leapfrog effect as we get over this minimum viable quality bar in different domains because the areas where we're just talking about healthcare operations. I have not been super enthusiastic about selling healthcare IT over the last decade. looked at it often on healthcare is a quarter of the American economy. I mean, globally, it's very important to every single human being and is not particularly efficient. It is especially inefficient in the United States. It is hard not to want to work on, except then you look a little closer at the companies that actually work in this space. And you're like, ah, the incentives are a mess. It's super slow. The ecosystem is extremely complicated. There's regulatory capture in every zone. But there's so”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  48. “The bar is really high. We haven't hit minimum viable quality. And so part of that is all the clever things we're talking about in terms of entrepreneurs designing systems and product scope such that the experienced quality by the user is good enough. But part of it is just we need a little bit more from the models, but it's coming. We need lower hallucination from models.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  49. “If we just narrowed the scope of it to models that were more verifiable, more calibrated, better hallucination management, these are things that block the enterprise from adoption. There is, I actually think people are asking this question for good reason, but there's so much enthusiasm and so much CapEx spend against AI model development right now. The idea that we're going to hit an air pocket because adoption of these tools in the enterprise where there's real economic value is lagging, I think that is real. But if you talk to companies like, oh, there's the things that are just the enterprise overall, like change management. But when you ask them, what is a problem from a risk perspective? The adoption of AI in large foundation model-based applications internally or externally built in large financials traditionally a huge spender in technology is marginal. It is extremely low. And it's because from a risk compliance reliability perspective,”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source

  50. “I would say, I mean, the perfect version of GPT 5 is a lot. So, you know, root-free, Sam, bring it out. But, well, of all of those things are true, I think we're in a really different zone.”

    2024-08-06 · Invest Like the Best · Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383] · IDENTIFIED FROM THE TRANSCRIPT · source