YouSaid · the spoken record

Mira Murati

lines on the record: 44
first: 2024-06-13
most recent: 2024-06-13
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“Knowledge and creativity. And it can, you know, even if you consider like learning how to learn, that kind of happens very late in life, maybe college, maybe even later. And that is such a fundamental thing. But if we were able to really grasp this and get this, really learn how we learn at much younger age. I think that is very powerful and it can push human knowledge and pushing human knowledge can push the entire civilization forward. All right.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“And in terms of the promise, one of the things I am very excited about is having high quality and free education available everywhere in some remote village, really in the middle of nowhere. For me, education was very important personally. It was everything. It really changed my life. I can only imagine, you know, today we have so many tools available. So if you have electricity and internet, a lot of these tools are available. But still, you know, most people are in classrooms with one teacher, 50 students, and so on. And everyone gets taught the same thing. Like imagine if education is catered to the way that you think, to your culture norms, and to your specific interests. That could be extremely powerful in extending the level of”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“That is, I think, the biggest risk. Now, in terms of some specific scenarios, I mean, how are democracies interact with this information or with technologies is incredibly powerful? And I do think there are major risks around persuasion, where you could persuade people very strongly to do specific things. You could control people to do specific things. And I think that's incredibly scary to control society, to go in a specific direction.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Okay, so first of all, I don't think it's a preordained outcome. I think that we have a lot of agency for how we build this technology and how we deploy it in the world. And in order to get it right, we need to figure out how to create a shared responsibility. And I think a lot of that depends on understanding the technology, making it very accessible. The way it goes wrong is by misunderstanding it. Not understanding the capabilities and not understanding the risks.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“We did build voice engine in 2022. And we had not re-listed. And even now it's in a very limited approach because we are trying to figure out how to deal with these issues. But you can't make it robust on your own. You actually need to partner with experts from different areas, with civil society, with governments, with creators to figure out how to actually make it robust. It's not one-stop safety problem. It's quite complex. And so we need to do the work.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“I think that's kind of hopeless approach. These technologies are amazing. They carry incredible promise. And we can get this right.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Provenance of information. And this is for text specifically. Sorry, that's for images specifically. And we're also looking for watermarking. We're looking at watermarking techniques to implement in text and how to do that robustly. But the point is that people should know when they're dealing with deepfakes and we want people to trust the information that they're seeing.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Follows the content in other platforms on the internet, like a passport. And we've also opened up to Red Seaming classifiers for DALI, where you can detect that an image has been generated by DALI or not. So metadata and classifiers are too technical ways to deal.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Well, there were a few other voices, but the point is that it wasn't intentional and we work really hard to reduce the political bias in model behavior and will continue to do this and also the hallucinations. And then the third thing is we want to point people to the correct information when they're looking for where they should be voting or voting information. We're focusing on these three things when it comes to elections, but broadly for misinformation, I would say deepfakes are unacceptable, so we need to have very robust ways for people to understand when they're looking at a deepfake. We've already done a couple of things. We've implemented C2PA for images. And so it's sort of like metadata that”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“With the current systems, they're very capable of persuasion and influencing your way of thinking and your beliefs. And this is something that we've been studying for a while, and I do believe it's a real issue with AI. It gets majorly exacerbated. So especially in the past year, we've been very focused on how to help election integrity. And there are a few things that we are doing. So number one, we're trying to prevent abuse as much as possible. And so that includes improving the accuracy of detection, political information detection, and understanding what's going on in the platform and taking quick action when that happens. So that's one. The second thing. Is reducing political bias. So you might have seen the ChatGPT was criticized for being overly liberal.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Having everything they can. I do think that's. Yeah, I do worry about the perception, but all you can do is just do the work, get it right, and then people will see what happens and you will build trust that way. I don't think there is some magical way to build trust other than actually do the working, do it right.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, look, we have a strong partnership, but the selection of the voice was not a high priority, not something that we were working on together. I was making the decisions on that. And Sam has his own relationships. And after I selected the voice behind Sky, he had reached out to Scarlet Johansson. So, you know, we didn't talk to each other about that specific decision, and that was unfortunate.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“I mean, all the time. That is, I think it's normal when you're doing what we're doing and Sam will push the team very hard. And I think that's good. It's great to have big ambition and to test the limits of what we can do and when I feel like it's beyond basically I can push back and that's sort of the relationship we've had for over six years now And I think that it's”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“I mean, look, there is so much interest around the people running these companies. Obviously, it makes sense, and OpenAI and all the drama that happened then, and it's understandable. At the end of the day, we're just people running these companies. We have disagreements. We work through them. And at the end of the day, we all care deeply about the mission. And that's why we're there. And we put the mission and the team first. Sam is a visionary. He has great ambition and he's built an amazing company. We have a strong partnership and all the things that I've shared with the board when they asked Joreinu, so it's nothing.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, in my opinion, that's overly cynical. I mean, there is this incredible team at OpenAI that joined because of the mission of the company. And I don't think all thousand people at OpenAI are trying to do that. I mean, we have this incredible talent, people that care deeply about the mission of the company. And we're all working extremely hard to develop and deploy these systems in a way that is safe. And all you need to see is the track record. I mean, we've deployed, we were the first to deploy these systems in the world. And we have taken great care not to have.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Safety. And what I mean by that is in a few areas, not just the operational discipline, but also safety of our products and deployments today, which covers things like harmful biases and thinking about misinformation, disinformation, classifiers, all these types of work. And then we're also thinking about the alignment of the models long term. So not just the alignment of the models today, which we use reinforcement learning with human feedback to do that. But also the alignment of the models as they get more and more powerful. And this is a niche area of research where a lot of the concern.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Well, I think you have to ask them, but I think that many people think of safety as something separate from capability, that there is this separation between safety and capability and that you need to sort of advance one ahead of the other. From the beginning of OpenAI, I joined from aerospace and automotive, and these are industries with very established safety thinking and systems and places where people are not necessarily constantly debating around the table what safety is, but they're doing it because obviously it's really quite established. And so I think the whole industry needs to move more and more towards a discipline of safety that is very empirical. We have safety systems, we have rigorous discipline on operations.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“And, you know, I think that we do absolutely, I mean, everyone in the industry and OpenAI, we need to double down on the things that we've been doing on safety and security and preparedness and regulatory engagement given the progress that we're anticipating in the field. But I disagree on the fact that or maybe on speculation that maybe we've put product in front of safety or ahead of safety.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“A few things. So, the alignment team is not in charge of safety at OpenAI that is one of our safety teams. Very important safety team, but it is one of them. We have many, many people working on safety at OpenAI. And Jan is an incredible researcher, colleague. I work with him for three years. I have a lot of respect for Jan, and he left OpenAI to join Anthropic.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Sort of where the science leads us. And so it's understandable that people have fears and anxieties about what's to come. Now, I would say specifically, the work that we've done at OpenAI, the way that we've deployed these models, I think we have an incredible team and we've deployed most capable models very safely and I feel very proud of that. I also think that given the rate of progress in technology and the rate of our own progress, it's super important to double down on all of these things, security, safety, our preparedness framework, which talks about how do we think about the risk of training and deploying frontier models.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“There's differing opinions. We think debate is super important and being able to publicly voice these concerns and talk about issues on safety. And we've done this ourselves since the beginnings of OpenAI. We've been very open about concerns on misinformation, even since the GPT two days is something that we've studied since early on. I think that in the past few years there has been such incredible progress, such incredible technological progress that nobody anticipated and forecasted. And this has also increased the general anxiety around societal preparedness as we continue this progress. We see”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Because for the AGI definition specifically, yes, and that's important. And I think the definition of intelligence will continue to evolve. But I think what's equally important is how it affects society and at what rate it actually penetrates using that difference.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“So, I do expect that this definition will continuously evolve. I think perhaps what's going to become more important is assessing, evaluating, and forecasting impact in the real world, whether it's societal impact as well as economic impact in the real world.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“So, people will define AGI differently. We have a definition of AGI by the charter, which is the systems that can do economically valuable work across different domains. From what we're seeing now, the definition of intelligence just keeps changing. A while back we would look at academic benchmarks to test how intelligent the systems were. And then once we saturated these benchmarks, we looked at exams, school exams, and eventually, you know, when we saturate those, we'll have to come up with new evals. And it makes you think, how do we evaluate fit and intelligence in a work environment? We have interviews, we have internships, we have different...”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“We don't know, but I mean, that's going to, I don't know what we will call it. But the next large model is going to be quite capable and we can expect big leaps like we've seen from GPT-3 to GPT-4. But we don't know yet”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“So, yeah, on JubyD40, it all stands for Omni Model because it ties together all the modalities, vision, text, audio. And what's so special about this model is that And that's a huge jump in the interaction with AI. It's quite different from the previous releases that we have made. We wanted to make this the latest capability free for all users. We wanted everyone to get a sense for what the technology can do, what this new modalities look like, and also understand the limits of it. And it goes to what I was saying earlier, that you actually want to give people access to bring them along because it's so much easier to understand the potential and the limitations of a technology if you're experiencing it and if you have an intuitive sense for what it is.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Disagree with that because my background is in engineering. Our entire world is engineered. Engineering is risk, right? Like the entire human civilization is built on engineering practice, like our cities, our bridges, everything. And there is always risk that comes with that. And you manage that risk with responsibility, but it's not just the developers, it's a shared responsibility. And in order to make it shared, you actually need to give people access and tools and bring them along instead of building it in vacuum and technologies that are not accessible.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Its consequences that That we will feel on our skin and on our society. So by that, I don't necessarily actually mean regulation or legal ways. I mean, a moral imperative to get this right. It's, you know, I'm optimistic, and I think this technology is incredible, and it will allow us to do just amazing, amazing things. I'm very excited for its potential in science, in discovery, in education in particular, in healthcare. But whenever you have something so powerful, there is also the potential for some catastrophic risk. I mean, this has always been the case. Humans have tried to amplify it.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“So, you know, I think This is really incredible in magical technology, but the breadth, the reach, the consequence is also great. And so it's important that we get this right. Now, of course, at OpenAI list, we use iterative deployment strategy. So we usually release to a small group of people. We try to identify edge cases. And once we feel confident about how we handle them, we expand access. But you need to figure out what is the product surface and what's the business model around it. And we haven't been able to do that.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“I'm going to ask about her Well, video has a bunch of other issues, right? Because especially when done very well, which I think Sora is quite remarkable. Video is very visceral, and of course, it can be very emotionally evocative. So we have to address all the safety issues and figure out the guardrails and figure out how do we actually deploy a useful and helpful product, but also from a commercial perspective, nobody wants a product that is going to create a bunch of safety or reputational scandals out there.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Don't have a timeline for public release for Soray yet. What we're doing right now with Sora is we've given access to red tumors and we've given access to some content creators to help us identify ways to make this robust. We're doing a lot of work on safety front, but also to figure out how do we actually bring this to the public in a way that's useful. That's not very straightforward. Right now it's really a technology. And this has been a pretty consistent process that we have followed with every new technology that we have developed. We will usually work with those that have, like for example with DALI, we worked with creators initially and they helped us identify ways to create an interface that where they felt more empowered than they could create more projects. Basically, you just want to extend the creativity of people.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“And we are doing a set of things to experiment with ways to compensate people for data creation. So we're building this tool that we're calling content media manager and this will allow us more specifically to Identify the types of data that”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“So, I can all tell you specifically where the data comes from, but the data comes from these three categories. So I can give you the specific source because, I mean, this is trade secret and it helps us stay competitive. But I can tell you that”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Right, but the model could interpret the guidance as, you know, here are some tips to avoid shoplifting and accidentally kind of gives you sort of things that you could do, but that's not so much model behavior, there's so much on the person, and that goes into the area of misuse. But this just goes to show that model behavior is actually quite complicated and it's not as simple as picking liberal values or other values.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“How model behavior works and the types of decisions that we make internally at OpenAI and that we make with human labelers. And you see by looking through the spec, you see the complexity of what's going on, that sometimes direction is in conflict. Like for example, you might say to the model, I want you to be very helpful and also I don't want you to disobey the law. And let's say someone puts in a prompt that says, you know, give me some tips to shoplift. Then the model is meant to be very helpful, but also it's not supposed to help you with something illegal. And so it's not helpful. Yeah, maybe. So”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“But this is important because then people keep asking how it works, and it goes into the transparency questions. And this is where we can describe the tools that we are using to provide transparency to the public about what we're doing. So understanding this first part is very, very important, how the large language models work. And you're combining this architecture, neural nets, and a lot of data and a lot of compute. And you get this incredible intelligence. And as we are thinking about providing transparency into the model behavior and how things work, one of the things that we've done is actually share with the public this document that we call the spec, the model spec.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“That's a great question from Fei Fei. So, in terms of the relationship of data and models, this is actually something that a lot of people misunderstand about AI models and in particular large language models. The developers of these models, they're not pre-programming these models to do something specific. In fact, they are putting in a bunch of data, so these models are ingesting a huge quantity of data, and they are this incredible pattern matching systems. And through this process, intelligence emerges, so they learn to write and they learn to code, they learn to do basic math. They learn to summarize information and all sorts of things. We don't know exactly how this works, but we know It works. That's encouraging. It's very powerful.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“I mean, I can comment on the losses specifically, but You know, it just actually, yeah, it's quite unfortunate because, of course, we think that it is valuable to have news data and this type of information on the product. And so we try to figure out a partnership, a deal around that. But in that case, it didn't go well.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“And the way that we think about publisher deals specifically is we care about accuracy of information, we care about news, and our users care about that. They want to have accurate information and they want to see news on ChatGPT. And so it is product-based relationship where there is value provided to the users through the product. And we're experimenting with different ways to monetize and give content creators basically some form of compensation for having their data show up in the products or being used in training or whatever we are doing with the data. But it is a very specific partnerships that we're doing one-on-one with specifics.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“So I know you'll ask about this at some point. So I might as well tell you now. So when we look at the data to train our models, we're looking at sort of three different categories, the publicly available data. We look at partnerships that we've made with publishers.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Perhaps not the best example. But the point is that it is iterative whenever there is a new technology, we adapt to it. And I think there is a technical innovations aspect that are going to help us deal with misinformation. And then there is the people issues and societal preparedness. That is perhaps even more complex.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Specifically to your question on misinformation, you know, this is obviously very complex because we're building on top of decades of misinformation and it's becoming even more and more intense with AI, but of course we've got the internet, we have social media, and these are compounding effects in a way. It's actually good that AI is bringing all of this to a head and there is such scrutiny and intensity on this issue because it feels like there is more of a collective effort and responsibility to do something about it that is meaningful. I think it's going to have to be iterative, so we'll have to try out things as we go. And I mean, if you look at the governance of In media in the past hundred years, this better than me, it's been sort of iterative every time there is a new technology, things adapt.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“I think this is a very aligned partnership when it comes to privacy, when it comes to trust. I mean, for the mission of OpenAI, it is so critical that we build technologies and we deploy them in a way that people feel confident around them and they feel like they have agency and input into what we're building. In that sense, this partnership is quite natural and we feel very aligned and it's only going to take us in deeper in the direction where we want to go.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, so I mean, I can talk about the product integration specifically. I can give you specifics on that. But what we're hoping to bring is really the capabilities of the models that we are developing and the multimodalities and the interaction to bring this thoughtfully into the Apple devices. Then it opens up a lot of opportunities. So that's what we're looking for. And yeah, I guess we had great technology.”
2024-06-13 · On with Kara Swisher · OpenAI CTO Mira Murati on ScarJo Controversy, Sam Altman & Disinfo Fears · IDENTIFIED FROM THE TRANSCRIPT