The Architect
Structured and legacy-driven; builds the systems and institutions that last.
Jeff Dean embodies The Architect, a leader whose influence flows from designing foundational systems that others build upon for decades. His fingerprints are on much of Google's core infrastructure, from MapReduce and Bigtable to Spanner and TensorFlow, work that reshaped how the industry handles data and machine learning at scale.
“We think are super critical, we might not publish some things we think are really interesting, but important for improving our products, we'll get them out into our products and then make a decision, do we publish this or do we give kind of a lightweight discussion of it, but maybe not every last detail and then other things I think we pu…”
“I mean, I would add on to that I'm not sure I agree completely, but it's a pretty interesting thought experiment to go in that direction. And even if you get part way there, it's definitely going to be a lot of compute.”
“And I think there's going to be a fair bit of that kind of compute. And that's the kind of thing where you have some UI questions around, okay, if you're going to have a user with 20 of these kind of asynchronous tasks in the background happening and maybe each one of them needs to get for more information from the user.”
“I mean, I think we should consider changing the training objective a little bit. Just predicting the next token from the previous ones you've seen seems like not how people learn. It's a little bit related to how people learn, I think, but not entirely.”
Radical Ventures: “The Collaboration that Built Modern AI: Geoff Hinton & Jeff Dean in Conversation with Jordan Jacobs”
LISTEN AT THE SOURCE ↗THE RECORD IS CHECKABLE