YouSaid · the spoken record

Isa Fulford

lines on the record
65
first
2025-08-08
most recent
2025-08-08
sittings or episodes
1
sources
podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

  1. “I think with GPT 5, it kind of sets like a new, it's obviously state of the art in like all the things we talked about. But I think if you're showing that we can continue pushing the frontier here, and I feel like there's always people like, oh, we're hurting a wall, like things aren't actually improving. And I think the interesting thing is I feel like we've almost saturated a lot of these evals in the real metric of how good are our models we're getting is, I think, going to be like usage, right? Like what are the new use cases that are being unlocked and like how, like how many more people are using this in their daily lives to help them across multiple tasks? So I feel like that's actually the ultimate usage in terms, like that I'm excited about for in terms of like, are we getting to AGI?”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  2. “I mean, people always say vibe coding. I think basically non-technical people have such a powerful tool at their hands. I think really just need some good idea and like you're not going to be limited by the fact that like you don't know how to code something. Like you saw two of our demos, which were front-end coding or in the beginning. And that's just literally took minutes. I think that would have honestly taken me like a week to actually build like fully interactive. And so I think we're just going to have a lot more. I would expect like maybe a lot more like indie type of like businesses built around this because of the fact that like you just need to have the idea write a simple prompt and then you get the full fledged app.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  3. “Agent models and then contribute it back to the frontier reasoning models. We always want to make sure that the capabilities that we're pushing with agents makes it into their flagship models as well. Yeah, that's great. Very self-reinforcing.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  4. “Yeah, we're excited too. But by the way, just on the topic of usage, you obviously have a lot of products with a ton of usage already. And since we have one of the deep research gurus here too, how did deep research, chat GPT operator, sort of your existing products inform how you went about approaching GPT-5? One thing that's interesting is with reinforcement learning a model to be good at a specific capability is very data efficient. You don't need that many examples to teach it something new. And so the way that we think about it on my team is we're trying to push capabilities and things that are useful to people. So like deep research was the first model to do like very comprehensive browsing. But then when 03 came out, it was also good at comprehensive browsing. And that's because we're able to take the data sets that we've created for the, you know, from”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  5. “Number of capabilities that we have in this model and the price point. I'm kind of excited to see all the new startups and developers.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  6. “I'm just really curious to see how all of these things reflect in usage, right? Like I think coding is way, way better. Like, what does this actually unlock for people? And I think we're really excited to be offering these models at the price points that we have because I think this actually unlocks a lot more use cases that really weren't there before. Maybe like previous competitor models were good at coding, but the price point is not as exciting. And so I think with this.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  7. “I guess for me, I find hallucinations, deceptions, like pretty related. So the model, and we kind of saw this a lot with the reasoning models. The reasoning model would understand that it didn't have some ability, but then it still really wanted to respond. I think it would be really baked it into the models that they want to be helpful. And so they're like, whatever I can say to be helpful in that moment. And that's kind of what we consider for like deception versus hallucination. Sometimes the model literally seems that they will just say something quickly. And we kind of see a lot of this rejection with the thinking. When the models are able to step by step, they actually can pause before blurting out an answer is kind of what it feels like with a lot of the previous models for hallucinations.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  8. “Yeah, the design of this model has been very, very intentional for model behavior, especially with the sycophancy issues that we had like a few months ago with 4.0. And we've just spent a lot of time thinking about like, yeah, what is the ideal behavior? And I think for post training, what's really one of the reasons why I really like post-training is it feels more like an art than maybe even like other areas of research because you kind of have to make all these trade-offs, right? Like you have to think about like for my rewards, like all these different rewards I could be optimizing during the run like how to like how does that trade off against it, right? Like I want the assistant to be like super like helpful and engaging, but maybe that's like a bit too engaging and getting too engaging gets to the overly effusive like assistance that we have. So I think it's really like a balancing act of trying to figure out like what are like the characteristics and like what do we want this model to actually feel like and I think we were really excited with GPT 5 because it's kind of a time to like reset and rethink about especially since it's so easy to make something I think very engaging in the sense that”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  9. “Really exciting to see. Loved the demos in the live stream too. I wanted to ask about model behaviors because I know you worked on that too. But how did you guys think about that for GPT-5? And there are a lot of things that we've talked about in prior models of like syncophancy and characteristics like that. How did you guys think about for this? What did you guys change or tweak?”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  10. “There's going to be a lot more we can do with front end. I think the way we've gone this big leap, I mean, if you compare it to 03s, front end coding capability, this is just totally next level. It feels very different. And I think it kind of just goes back to what I was saying. The team just really cared about like nailing front end. And that means like getting the best data, like thinking about the aesthetics of the model and all of these things.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  11. “Yeah, I think huge shout out to the team, especially Michelle Pokeris. I think to get these things right with eval numbers is one thing, like I said, but to get the actual usability and how great it is at coding, I think it takes a lot of detail and care. I think the team put a lot of effort into data sets and thinking about the reward models for this. But I think it's just literally just caring so much about getting coding working well.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  12. “I'm honestly really excited. I think obviously we have some great eval numbers and numbers are always really exciting, but I think the thing I'm like really excited about this model is just it's way more useful. Like in cross all the things that people actually use chat for. And it's not just like, and it's, I think the email numbers look good, but then also like the way when people use it, I think they'll notice it quite a bit big of a difference when the utility of it. I mean, this is my personal use cases. I used it for coding and writing all the time. And it's just a huge step change.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  13. “Yeah, I've been on OpenAI for about four years now. I originally worked on WebGPT, which was the first LLM using tool use, but it was just one question. So the model learned how to use a browser tool, but you only ask one question you got answered back. And then we kind of just had this realization like, oh, normally when you have questions, you have more questions after that. And so we started building this chat bot. And then that's what eventually became chat GPT.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  14. “I think we hear this with GPT 5 internally when people are testing it. They're like, oh, I thought I asked a really hard question. I feel like a little bit insulted that it got two seconds. When it doesn't even want to sink at all.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source

  15. “I mean, I think it's pretty unique at OpenAI to be able to work on something that's so generally useful. I mean, it's like everything they tell you not to do at a startup. It's just like your user is anyone.”

    2025-08-08 · a16z Podcast · GPT-5 and Agents Breakdown – w/ OpenAI Researchers Isa Fulford & Christina Kim · IDENTIFIED FROM THE TRANSCRIPT · source