YouSaid · the spoken record

Logan Kilpatrick

lines on the record: 63
first: 2024-02-08
most recent: 2024-02-08
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“I love it. I think the phrase of people being worried about humans being replaced by AI, and I've seen this narrative online that it's like, it's not AI that's going to replace humans. It's like other humans that are being augmented and like using AI tools that are going to be more competitive in the job market and stuff like that. So go and try these AI tools. Like this is the best time to learn. Like you're going to be more productive and like empowered in your job and the things that you're excited about. So yeah, excited to see what people use ChatGPT for.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, Twitter and LinkedIn, Logan Kilpatrick, or Logan.gpt on Twitter. Please shoot me messages. Like I get a ton of DMs from people and it's always really, really interesting stuff. I think the thing that I that I would love to have held on is like if people find bugs and things that don't work well in ChatGPT, like I oftentimes like see people be like this thing didn't work really well. And the key and I think we need as open AI to do a better job of like messaging this to people but having like shared chats or like actual like tangible reproducible examples are like the two things that we need in order to like actually fix the problems that people have. Like the model laziness was a good example where it was kind of hard to figure out what was going on because people would be like, oh, the model's lazier, but like it's hard to figure out like what were the prompts they were using, what was the examples, all that stuff. So send those examples as you come up on things that don't work well and we'll make stuff better for you.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I think today if you were to do this, like I think the go-to question would be something along the, so an AI walks into a bar and likely because, again, it's trained on some distribution of training data. And like that's like the most common joke that comes up. And that's probably like, I wonder if you came up with a joke right now whether or not that would show up in one of the examples.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Quest I've got it. It's on a post-it note that right behind my camera. And it's measure in hundreds. I love this idea of measuring things in hundreds. And it's for folks who are like at the beginning of some journey. I talk to people all the time. They're like, yeah, I've tried this thing and it hasn't worked. And if your mental model is to measure in hundreds, if I measure in hundreds the five times that you failed at something, you failed and tried zero times. And I love that. It's like such a great reminder that. Everything in life has like built on compounding and multiple attempts at stuff. And if you don't try enough times, like you're never going to be successful at it.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Come to narrative of sleep. I have this really nice sleep mask from this company called Not Being Paid to say this, but it's called like manta sleep or something like that. It's a weighted sleep mask and it feels incredible when I, I don't know, maybe I just have a heavy head or something like that, but it feels good to wear a weighted sleep mask. And I really appreciate it.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm oftentimes it's just an entertaining question to ask in some sense, but it's also interesting to see what somebody's like deeply held strong belief is. I think that's, and not to judge whether or not I believe in that, but like just curious to see why people feel that way.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I'm a sucker for like a good inspirational human story. So I watch with my family recently over the holidays this grand turismo movie. And it's a story about someone who like this kid from.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I think the first one is one that I read a long time ago and came back to recently is the One Room Schoolhouse by Salcon. Incredible, yeah, I don't want to, it's a lightning round, so I won't say too much, but like incredible story and AI is what is going to enable StyleCon's vision of like a teacher per student to actually happen. So I'm really excited about that. And the other one is that I always come back to is why we sleep. Sleep science are so cool if you don't care about your sleep. Like it's one of the biggest up levels that you can do for yourself.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Twitter, LinkedIn, my email should be findable somewhere. I don't want to say it. And I think it's spanned with a bunch of emails. You should be able to find my email if you need it online somewhere. But yeah, Twitter and LinkedIn is usually like the easiest place”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I've made this statement a few times online in other places, but like for people who have cool ideas that they should build with AI, like this is the moment. Like there are so many cool things that need to be built for the world using AI. And like, Again, if I or other folks on the team at Obern AI can be helpful in getting you over the hump of starting that journey of building something really cool, please reach out. The world needs more cool solutions using these tools and would love to hear about the awesome stuff that people are building.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“It's like the actual question that I have and like in a normal product experience today, like I have to go into a bunch of dashboards and change a bunch of filters and stuff like that. And what I really want is just like ask my question. What are people doing? What are people saying about GPT4? Like get an answer to that question in a very data grounded way. And I've seen people part of this problem where like, oh, let me go a few examples of what people are saying. And like, well, that's not really what I want. Like I want this summary of what's happening. And I think it just takes a little bit more engineering effort to make that happen. But I think it's like that is the magical unlock of like, wow, this is an incredible product that I'm going to continue to use instead of like, yeah, this is kind of useful, but like I really want more.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I think going back to this theme of new experiences is really exciting to me. Like I think consumers are Just going to be like you're going to have an edge on other people if you're providing AI that's not accessible in a chatbot. Like people are using a ton of chat and like it's a really valuable service area. Like it's clearly valuable because people are using it. But I think products that like move beyond this chat interface really are going to have such an advantage and also like thinking about how to take your use case to the next level. Like I've tried a ton of chat examples that are like very, very basic and like providing a little bit of value to me. But I'm like, really, this should go like much further and like actually build your core experience from the ground up. Like I've used this product that allows you to essentially like manage or like view the conversations that are happening online around like certain topics and stuff like that. So I can go and look online. Like what are people saying about GPT-4? And like that, what I just said out loud, what are people saying about GPT-4?”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I think historically people really were only using embeddings for like it only worked really well for English and I think now you can you can use it across like so many new languages because it's it's just so much more performant across those across those languages and it's like five times cheaper as well which is wonderful i there's there's no there's no better feeling than making things cheaper for people i i love it i think now it's like you can embed i'm pretty sure it was like 62 000 pages of text for one dollar which is which is very very cheap so lots of really cool things you can do with embeddings i'm excited to see people embed more stuff”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, LennyBot.com. And my assumption was that Lennybot.com is actually powered by embedding. So you take all of the corpus of knowledge, you take all the recordings, your blog post, you embed them. And then when people ask questions, you can actually go in and see the similarity between the question and the corpus of knowledge and then provide an answer to somebody's question and reference like an empirical fact, like something that's true from your knowledge base. And like this is super useful and people are doing a ton of versus like trying to ground these models in reality in what they know to be true. Like we know all the things from your podcast to be at least something that you've said before and to be true in that sense. And we can bring them into the answer that the model is actually generating in response to a question. So that'll be super cool. And these new v3 embeddings models, again, you know, state of the art performance. The cool thing is actually the non-English performance has increased super significantly.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, updating it. So there's a few different things. A couple of quick ones are updated GPT-4 turbo model, updated the preview model that we released at DevDay. There's an updated version of that. It fixes this if folks have seen online people talking about this sort of laziness phenomenon. The big thing is the third generation embeddings model. So we were talking off camera before recording about all of the cool use cases for embedding. So if folks have used embeddings before, it's essentially the technology that powers like many of these question and answering with your own documentation or your own corpus of knowledge. And Lenny, you were saying you actually have a website where people can ask questions about recordings of the podcast. Anybody.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“There's also like a bunch of security stuff too. Like, if you want to control, you don't want people to use certain GPTs from the GPT store because you're like worried about security or privacy and stuff like that. You don't want your private data going in places. It makes a lot of sense to sign up for that so that you have a little bit more control over what's happening.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah. So I think a lot of our B2B customers are using the API to build stuff. So I think that's one angle of it. I think if you're a ChatGBT B2B customer, we sell teams, which is the ability to get multiple subscriptions of ChatGPT, package it together. We also have an enterprise version of ChatGPT. There's a bunch of like enterprise-y things that enterprise companies want around like SSO and stuff like that related to ChatGPT Enterprise. I think the coolest thing is actually being able to like share some of these like prompt templates and GPT's internally. So again, you can make custom things that work really well for your company with like all of the information that's relevant to solving problems at your company and like share those internally. And to me, that's like, you know, you want to be able to collaborate with your teammates on the cool things you create using AI. So that's a huge unlock for companies. I think that those are like the two biggest value adds. There's like higher limits and stuff like that on some of those models. But I think being able to share your very domain.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Is going to be like doing backflips in the background of my bedroom while it also writes all my code for me and talks on the phone with my mom or something like that. I'm like, that's not the case. It is just going to be this very effective tool, very similar to GPT-4. And it's also going to become very normal very quickly. And I think like that is actually a really interesting piece if you can plan for the world where people become very, very used to these tools very quickly. I actually think that's like an edge and like assuming that this thing is going to like absolutely change everything in many ways I think is actually like a downside is like the wrong mental framing to have of these tools as they come out.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“GPT 4 came out. The consensus from the world is everything is different. Like all of a sudden everything is different. This changes the world. This changes everything. And then slowly but surely we come back to reality of like, this is a really effective tool and it's going to help solve my problems more effectively. And I think that is like the undoubtedly the lens in which people should look at all of these model advancements. Like GPT-5 is like surely going to be extremely useful and like solve some whole new echelon of problems. Hopefully they'll be faster. Hopefully they'll be better in all these ways. But like fundamentally the same problem that exists in the world are still going to be the same problems you now just have a better tool to solve those problems. And I think like going back to like vertical use cases, like I think people who are solving very specific use cases are just now going to be able to do that much more effectively. Like I don't think that's like going to people had these unrealistic expectations that like GBT5”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“If folks have looked through the GPG4 technical report that we released back in March with GPT-4 came out, GPT-4 was the first model that we trained where we could reliably predict the capabilities of that model beforehand based on the amount of compute that we were going to put into it. And you could actually, we did like a scientific study to show like, hey, this is what we predicted. And here is what the actual outcome was. So it'll be one, I think, just as somebody who's interested in technology, but interesting to see like, does that continue to hold for GPT-5? And hopefully we'll share some of that information whenever that model comes out. I also think you can probably draw a few observations. One of them, which is”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“You and now you can go and try GPT, have it actually solve the problem and be like, wow, it did this thing for me. I should probably spend the time to investigate these five other problems that I have to see if AI can also be a solution to those. So I think so many more people are going to come online and start using these tools because very like narrow vertical tools are what's going to be like a huge unlock for them.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“If you think back to all these human analogies, like that's what we do with humans, I don't expect somebody when I ask them to do something meaningful for me to do it right away and like give me the answer back right away. So I think pushing more towards those experiences is what is going to unlock like so much more value for people. And I think the last thing is GPTs as this mechanism to get like the next few hundred million people into ChatGPT and into AI. So I think like if you've had conversations with people who aren't close to the AI space, oftentimes you talk about even if they've heard of ChatGPT, a lot of people haven't heard of ChatGPT, but if they have, they're like, they show up in ChatGPT and they're like, you know, I don't really know what I'm supposed to do with this. This blank slate, I can kind of do anything. It's like not super clear how this solves like my specific problem. But I think the cool thing about GPTs is you can package down like here's this one very specific problem that AI can solve for you and do it really well. And like I can share that experience.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah. New modalities. I think ChatGPT, like continuing to push all of the different experiences that are going to be possible. Like today, like ChatGPT is really just like text in, text out, or I guess like three months ago was just text in text out. We started to change that with now you can do the voice mode and now you can generate images and now you can take pictures. So I think like continuing to expand like the way in which you interface with AI through ChatGPT is coming. I think GPTs is our first step towards the agent future. Like again, today when you use”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Like tackle some completely different research direction, you now have to share your GPUs with that person and everyone else is now slower on their experiments. So it's a really interesting like trade-off that research folks have that I don't think like product folks, like if I add another engineer to like our API team or to some of the ChatGPT teams, like you can actually write more code and do more. And that's actually like a net beneficial improvement for everybody. And that's always not the case in the case of researchers, which is interesting in a GPU constrained world, which hopefully we won't always be in.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“There's a couple of things, one of which is the actual research team who seeds most of the innovation that happens at OpenAI is intentionally small. They're not like, you know, most of the growth that OpenAI has seen is around like our customer facing roles, our engineering roles to provide the infrastructure to protect GBT and things like that. The research team is like, again, intentionally kept small. And there's all of this talk. And it's really interesting. I just saw this thread from one of our research folks who was talking about how in a world where you're constrained by the amount of GPU capacity that you have as a researcher, which is the case for open AI researchers, but also researchers everywhere else, like each new researcher that you add is actually like a net productivity loss for the research group unless that person is like up leveling everyone else in like such a profound way that like it increases the efficiency like if you just add somebody who's going to go”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I think the last public number was something around like 750 near the end of last year, 780 or something like that near the end of last year. And we're still growing so quickly. So I don't want to, I won't be the messenger to share the specific updated numbers, but like the team is growing like crazy and we're also hiring across all of our engineering teams. So folks are NPM teams. So if folks are interested, we'd love to hear from folks who are curious about joining.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I know they're real people. There is no AGIs yet. But I think, like, yeah, even Slack is building a bunch of really cool AI tools, which I'm excited to. And that's why there's so much cool AI progress. And like at the end of the day, it's so exciting from being like a consumer of all these new AI products. Like Google is a great example. I'm so happy that Google is doing really cool AI stuff because like I'm a Google Docs customer and like I love using Google Docs like a bunch of their other products and like it's awesome that people are building such such useful things around these models.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Think there's a non trivial benefit to using Slack. And I think maybe that's controversial and maybe some people don't like Slack. But OpenAI is such a Slack heavy culture. And like it really, the like instantaneous real-time communication on Slack is so crucial. And I just love being able to like tag in different people from different teams and get everybody coalesce. So like everybody is always on Slack. So it's like even if you're remote or you're on a different team or in a different office. so much of the company culture is like ingrained and slack and it allows us to like really quickly coordinate where like it's actually faster to send them a slack message sometimes than it would be to like walk over to their desk because they're on slack and they're going to they're going to be using it and i saw uh if you saw the recent salmon and bill gates interview but sam was talking about how slack is his number one most used app on his phone i'm like i don't even look at the time thing on my phone works and like i don't want to know how long i'm using”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, adoption is a great one. I think there's like a bunch of metrics around revenue, number of developers that are building on our platform, all those things. And a lot of these, and I don't want to dive, I'll let Sam or someone else on our leadership team go more into details. But I think like a lot of these are like actual abstractions towards something else. even if revenue is a goal, it's like revenue is not actually the goal. Revenue is a proxy for getting more compute, which is then like actually what helps us get towards getting more GPUs so that we can, you know, train better models and like actually get to the goal. So there's all these like intermediate layers where like even if we say something is the goal and like you hear that in a vacuum and you're like, oh, well, Open AI, I just want to make money. And it's like, well, really, money is the mechanism to get better models so that we can achieve our mission. And I think there's a bunch of interesting angles like that as well.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Think it's like much higher level. I actually don't think Open AI is like a big OKR company. I don't think teams do okay today and I don't have a good understanding of why that's the case, whether or not, I don't even know if OKRs are like still the industry. You're probably talking to a lot more folks about like, yeah, who are making those decisions? So I'm curious, is that something that you're seeing from folks? Like, is it still common for people to do OKRs?”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“All the principles about how we're making the decision. I think like the actual planning process is pretty standard. Like we come together. There's like H1, Q1 goals. We all sprint on those. I think the real interesting thing is like how stuff changes over time. Like you think we're going to do these Turmoil and change. And it's interesting to have like mechanisms to be like, hey, how do we update our understanding of the world and our goals as everything sort of, the ground changes underneath of us as is happening in the craziness of the AI space today?”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Abstractions, though, like, are we giving customers a robust and reliable experience on our API? And like, that's often like the first question. And I think there have been times where we've fallen short on that. And like, you know, there was a bunch of other things that we've been thinking about doing and like really bringing the focus and priority back to that reliability piece. Because at the end of the day, nobody cares if you have something great, if they can't use it robust and reliably. So there's like these core tenets. And I think like, again, we have like very other than”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Think this is one of the more challenging At OpenAI, there's so many, everyone wants everything from us. And like today, especially in the world of ChatGPT and how large and well used our API is like people will just come to us and say like, hey, we want all of these things. I think there's like a bunch of core guiding principles that we look at. Like one, going back to the mission, like, is this actually like going to help us get to AGI? So there's a huge focus on like, you know, there's this potential shiny reward right in front of us, which is like, you know, like optimize user engagement or whatever it is. And like, is that really the thing? Like maybe the answer is yes. Like maybe that is what is going to help us get to AGI sooner. But like looking at it through that lens, I think is like always the first step of deciding any of these problems. I think on the developer side, there's also these like core tenets of like reliability. Like, hey, you know, it'll be awesome if we had additional APIs that did all these cool things, like new endpoints, new modalities, newer.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Think the assistance API that we released for Dev Day, like We continue to get this feedback from developers that people wanted these higher levels of abstraction on top of our existing APIs. And like a bunch of folks on the team just came together and were like, hey, let's put together what the plan would look like to build something like this. And then very quickly came together and actually built the actual API that now powers so many people's assistant applications that are out there. And I think that's a great example of like, you know, it wasn't like this like top down like, oh, someone's sitting there being like, oh, let's do these five things. And then like, okay, team, go and do that. It's like people really seeing these problems that are coming up and like knowing that they can come together as a team and like solve these problems really quickly. And I think the assistance API and there's like a thousand and one other examples of teams taking agency and doing this. But I think that's a great one at the top of my head.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Take on the world if you have people who have high agency and like not needing to either. Get 50 people's different consensus because, like, you have people who you trust with high agency and they can just go and do the thing, I think is like one of the most, it is the most important thing. I'm pretty sure if you were to distill it down. And like I see this in folks that I work with, like folks are so high agency. Like they see a problem and they go and tackle it. Like they hear something from our customers about a challenge that they're having and like they're already pushing on what the solution for them is and not like waiting for all the other things to happen that like I think traditional companies are sort of stuck behind because they're like, oh, let's check with all these like seven different departments. So like, you know, try to get feedback on this. Like people just go and do it and solve the problem. And I love that. It's so fun to be able to be a part of those situations.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Know there's so many interesting trade offs in all of this like tension around how quickly companies can move. I think for us, like, again, if you think about Apple as an example, you think about NASA as an example, just like older institutions, like lots of like, you know, over time, the tendency is things slow down. There's like additional checks and balances that are put in place, which sort of drag things down a little bit. So we're young and like a new company. So like we don't have a lot of that like institutional legacy barriers that have been put in place. I think the biggest thing, and there's a good Sam tweet somewhere in the ether about this from, I think 2022 or something like that, but like finding people who are high agency and work with urgency is like one of the most, if I was hiring five people today, like those are like some of the top two characteristics that I would look for in people because it's you can.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Think my instinct is the zappier, all of the stuff that Zappier has done with GPTs is like the most useful stuff that you can imagine. Like you can go so far with what, and I don't know how it's like packaged for Zapier's GPT right now, but like you can actually as a third party developer integrate Zapier without knowing how to code into your GPT. So like they're they're pushing a lot of this stuff and then basically like all 5,000 connections that are possible with Zapier today, you can bring into your GPT and like essentially enable it to do anything. So I'm incredibly excited for Zapier and for people who are building with them because like there's so many things that you can unlock using that platform. So I think that's probably like the most exciting thing to me for people who aren't, who aren't developers.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Accessible to GPTs for people who can't code is really exciting. Like having to, even for me as like someone who is a software engineer, like it's not super easy to connect the Notion API or the Gmail API to my GPT. And like really, I'd love to just be able one click sign in with Gmail. And then all of a sudden it's like my Gmail is accessible or someone else can sign in with their Gmail and make it accessible. So I think over time, like all those types of things will come. But today it's really like custom prompts is essentially like one of the biggest value adds with GPGs.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“To external APIs so you can connect it to the Notion API or Gmail or all these different things and like have it actually take actions on your behalf. So there's so many cool things that people are unlocking. And what's been most exciting to me actually is like the non-developer persona is now empowered to like go and solve these like really, really, really more challenging problems by giving the model enough context on what that problem is to be able to solve. Going back to like context is all you need. This is very true in the context of GPTs. And if you give it enough context, like you can solve much more interesting problems, there's so many things that I'm excited about with this. I think monetization when it comes to the store later this quarter, I think is going to be extremely exciting. Like when people can get paid based on who's using their GPTs, that's going to be a huge unlock and like open a lot of people's eyes to the opportunity here. I also think like continuing to push on making more capability”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“It's going great. And again, historically, the thing that you would have to do, let's say, for example, you have like a really cool ChatGPT use case, what you would have to do to share it with somebody else is like actually go in and like start the conversation with the model, like prompt it to do the things that you want it to. And then you would share that link with somebody else before the action has actually happened and be like, here, now you can like essentially finish this conversation with ChatGPT that I started. So GPT's kind of changes this where you take all that important context, you put it into the model to begin with, and then people can go and like chat with essentially a custom version of ChatGPT. And the thing that's really interesting is you can upload files. You can give it custom instructions. You can add all these different tools, like a code interpreter is built in, which allows you to do like math essentially. You have browsing built in, image generation built in. And you can also for more advanced use cases if you're a developer, you can connect it.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Again, it's like the challenge with all this stuff is very nuanced. And it's also like, it's a small jump in performance. You could imagine like on the order of like one or two percent, which for a few sentence answer is like might not even be a discernible difference. Again, if you're generating like an entire saga of text, like the smiley face could actually make a material difference for you. But for like something small and textful, it might not.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Actually, we have a prompt engineering guide, which folks should go and check out. It has some of the examples. It depends on sort of the order of magnitude of like how much performance increase you can get. There's a lot of like really small, silly things, like adding a smiley face increases the performance of the model, like telling the, you know, you've seen, I'm sure folks have seen like a lot of these silly examples, but like telling the model to like take a break and then answer the question, all these kinds of things. And again, if you think about it, it's because the corpus of information that's trained these models is the same things that humans have sent back and forth to each other. So like you telling a human, like when I go take a break and then I come back to work, like I'm fresher and I'm able to answer questions better and like do work better. So very similar things are true for these models. And again, when I see a smiley face at the end of someone's message, like, I feel empowered that like this is going to be a positive interaction. And I should like be more inclined to give them a great answer.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Exactly. It wants to, it's so deeply wants to answer your question. It doesn't care that it doesn't have enough context. It's like the most eager person in the world you could imagine to answer the question. And without that context, it's just hard to do, to give up anything of value. If we got t-shirts printed, they should say like context is all unique. Context is the only thing that matters. It's such an important piece of Getting a language model to do anything for you.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Be like, yep, this is kind of what I wanted. Let me edit this. Let me edit this here. And again, the inherent problem is we're lazy as humans. We don't want to type all them. We don't really want to type what we mean. And I think AI systems are actually going to help solve some of that problem.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Of Dali. So when you go to the image generation model that we have, Dali and you say, I want to picture of a turtle. What it does is it actually takes that description. It says, I want a picture of a turtle and it changes it into their high fidelity, like, you know, generate a picture of a turtle with a shell, with a green background and lily pads in the water and all this other. It adds all this fidelity because that's the way that the model is trained. It's trained on examples with super high fidelity. This will happen with text models. You can imagine a world where you go into ChatGPT and you say, write me a blog post about AI. It automatically will go and be like, let me generate a much higher fidelity description of what this person really wants, which is, you know, generate me a blog post about AI that talks about the trade-offs between these different techniques and some example use cases and reference in some of the latest papers. And it does all that for you. And then you as the user will hopefully be able.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Context and agency to go and answer my question. I think this is like prompt engineering, my whole position on this is like prompt engineering is a very human thing. Like when we want to get some value out of a human, we do this prompt engineering. We try to effectively communicate with that human in order to get the best output. And the same thing is true of models. And I think it's like, again, because we're using a system that appears to be really smart, we assume that it has all this context, but it's really like, you know, imagine a human level intelligence, but like literally no context. Like it has no idea what you're going to ask it. It's never met you before. It has no idea who you are, what you do, what your goals are. And like, it's the reason that you get super generic responses sometimes is because people forget they need to put that context in the model. So I think this thing that is going to help solve this problem, and we already kind of do this in the context.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“This is such an interesting space, and I think it's like another space where I'm excited for people to do like more scientific empirical studies about because there's like so much gut feeling best practices that maybe aren't actually true in a certain way. I think the reason that prompt engineering exists and comes up at all is because the models are so inclined because of the way that they're trained to give you just an answer to the question that you asked crap in, crap out. If you ask like a pretty like basic question, you're going to get a pretty basic response. And actually the same thing is true for humans. And you can think of a great example of this when I go to another human and I ask like, how's your day going? They say, it's going pretty good. Literally absolutely zero detail, no nuance, like not very interesting at all versus, again, if you have some context with the person, if you have a personal relationship with them and I ask you, hey, Lenny, you know, how's your day going? Like, how did the last podcast go, et cetera, et cetera? Like, you just have a little bit more.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Yeah, I forgot what article I found online, but it was like some article that was talking about what are the best ways to like set yourself up for success in planning. And I took a bunch of the like, I'll see if I can make it public after this and send you a link, but took a bunch of the examples from that and went in and put some of those suggestions into the GBT. And then when now when I do any of my planning of like I want to build this thing, I put it through and have it like generate a timeline, generate all the specifics of like what are the metrics and success that I'm working for. who might be some important cross-functional stakeholders to like include in the planning process all that stuff and it's been it's been helpful”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“I've seen some interesting GPTs around the planning use cases. Like, you want to do OKR planning for your team or something like that. I just actually saw somebody tweet it like literally yesterday. I've seen some cool venture capital ones of like doing diligence on like a deal flow, which is kind of interesting and like getting some different perspectives. I think all of those like horizontal use cases where like you can bring in a different personality and like get perspective on different things i think is really cool like i i've personally used in gpt the private gpt that i use myself that like helps with some of the like planning stuff for for different quarters and like just making sure that i'm being consistent in how i'm framing things like driving back to like individual metrics stuff that like when people do planning like they often miss and like are bad at and it's been super helpful for me to like have a gpt to like force me to think about some of those things”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source
“Things that you could be using AI to do today and like really unlocking probably on the order of at least a 50% improvement, especially for some of the like lower hanging fruit software engineering tasks, like the models are just so capable at doing that work. And it's crazy to think, and I'm guessing actually GitHub probably has a bunch of really great studies they published around like co-pilots. And you could use those as an analogy for what people are getting from ChatGPT as well. But those are probably like the highest leverage things. I think now with GPTs, people are able to like go in and solve some of these more tactical problems. I think one of the general challenges with ChatGPT is like it gives like a decent answer for a lot of different use cases, but oftentimes it's not like particular enough to the voice of your company or like the nuance of the work that you're doing. And I think now with GPTs, like and people who are using.”
2024-02-08 · Lenny's Podcast · Inside OpenAI | Logan Kilpatrick (head of developer relations) · IDENTIFIED FROM THE TRANSCRIPT · source