YouSaid · the spoken record

Kawal Gandhi

lines on the record: 35
first: 2023-10-23
most recent: 2023-10-23
sittings or episodes: 1
sources: podcast

Every line below is reproduced as it was said and linked to the record it came from. Nothing here is summarised or generated. Directory · Search · Corrections

“Yeah, I think it was. Thank you. I think we covered all of it. I would love to come back in six months, take a look back and see how we move forward.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“We have the partner ecosystem to that. We provide a lot of partners. So exactly the marketplace. And if they want to take advantage of some of those providers, they can absolutely do that. They're integrated into our platform. So you can kind of say, I want this service for RLHF and reach out to them and then use it for your model training, et cetera. The most important thing, Sarah, is to make sure that they're working in congestion and whatever they are, you know, getting from the customer, it's secure. So it's not something used with another customer. So we make sure those pipelines and entitlements stay in the project.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“I'm working across the board with multiple customers on just making these user experience the next generation multimodal and how should we think about that and what are the real first use cases that we should kind of deeply work and partner together with them. So that keeps me really excited around that and how can we bring these to our platform and make it capable. Second is just the amount of shared data some of our customers want for their model training or available on our platform. That's the next thing we think about like are there data sets that we can offer out and we're also looking at synthetic data as well can we use in regulated industry some of the synthetic stuff and like recreate those simulation modes that can give them a good insight into some data that's missing.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Platform. And I think models in my mind are like 50, 60%, it's the workaround and how do you leverage your current investment is 30-40% work that goes in from the groups, from our customers as well. And then the upkeep and maintenance and all the operational elements are also important.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Absolutely, so we think about going back to the customer should have availability and optionality. So if there's a model that's coming out, it's been trained up, can we make it available like Lama inside a model garden? And then they can use it inside their application and not worry about the platform capabilities at all. And it kind of fits into currently and leverages that current investment. We think about that a lot. So just starting from the customer first and then making the technology available rather than thinking about here's another set of models that you need to kind of go take and do the scaffolding and the build out around that. So absolutely like as these come out Sarah and you know they will be new ones launched with some capabilities, different ways of training and approaches optimization and if we see our customers in a vertical kind of leaning towards that we want to make sure it's available on”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“And I think we are seeing the concentration on training side, but then the world focuses on a different problem, which is like let's focus on the rail, how do we deploy it inside your organization and make it successful. That's, I think, where the narration changes and then it doesn't even come back to talking about the chip shortage and availability, et cetera. But having said that, we are absolutely focused on making sure that the platform is available for customers and we see the demand coming as well towards us.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“definitely is mentioned as we think about it in the conversations it's always the the discussion that comes up but as you look at the applications and the usage and what they're really trying to solve you then get to the next step i think it just the conversation shifts around capabilities and platform so as we were discussing over here how do you keep the data secure how do you make sure the right teams have the access to it how do you make sure the data is regionalized for example and those answers are not easy to answer for some of the other providers for example and then it comes to like if models are going to be available do we really see that shortage playing out”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, I think inference will be something we really needed. You can see the numbers, right? Like an application launches and it goes from like 5, 10, 15, 100, right? And you're like, how do I scale this further out? And Sarah touched on it. What happens when we get into multimodal world, right? And if I'm an educator thinking about an education site, I'm not having that kind of luxury. That's really something we think about. We didn't talk about that vertical at all is education and people want to be learning, deploying, etc. How do we help those organizations come on board and take advantage of this as well?”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Can we kind of make that more prevalent and available is something we should kind of invest in the future. You're going to see that. More than that, I'm the team as such is thinking about inference because you get the trained, you get the application ready, and then the scale is where you don't know what character AI is like really thinking about scaling it out. We have other examples in Cora and Po, Adam's thinking about scaling out the application. So now you're going to see the shift on like we have v5e, et cetera, we are investing heavily and others are doing is how do you scale? And then keep the cost curve. Of going in the other direction. We're going to kind of invest and kind of put our effort on that”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Reason in my mind, it's just more around how many folks know how to do it directly is something top of mind for us because there is this that was externally available and a lot of people are trained up as more people get trained up we're seeing cost and benefits across the board right so having optionality is what we want to kind of bring forward constantly”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, I think how we think about it is like, can the platform be capable enough and have features, as I call them, that takes away the developer or engineer or team thinking about a project? From the infra piece, early days, like we used to write Windows app, I've written like Java application, and it's always about abstracting it away so you can manage it, scale it, and then roll it out faster. So I think we'll see a world gradually other than training and where it's trained and deployed, is it abstracted out from that layer in a way that it gives the fungibility and the adoption and the scale out that helps you kind of do that. That'll speed up in my mind. And then to your point, innovation on that layer is going to also continue.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“But has to be who accessed, when did they access, etc. But I think once you get over that, if you're writing a monitoring tool and it knows the schema, you don't need to go back and look at it and have an engineer work on it for like four weeks, right? Why can't it be generated out of, I just need a monitoring tool for model drift? So those benefits are going to”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, I think today, in my mind, it lives in docks. So you get a lot of benefit in the documentation and that's shared across. I think you've seen it like any project is like, let's start a doc, any hypothesis or experiment, let's start a doc. I really think there will be an evolution as a platforms mature where the docs can make suggestions and those suggestions could be held based on what you've speced out. Here is output. Now you can choose to ignore it. It could be a notebook as well. You said IDEs and UX. It could be just code written with put the API key here. It's great to kind of do that. But then when you're scaling up, that's where I get scaling. Like how does it going to scale up? You don't want these things to become something that doesn't have the guardrails around them. Who is entitled inside the organization to do this? So we have to make sure logging is on. It's simple things like logging. We will not think about.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Very interesting, and think about the investments you all make. Now, I have a platform in GCP which gives me models. I have a coding model that helps me code, and now I just need feedback. Capital allocation to go experiment. I think that's great. And then now I need to make it secure and scale it up. That's where we come in with our infra and then make it cost effective. I think we're like early stage of new era of even startups and big companies coming out of this and different solutions getting built out.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“I think they're all kind of early and adopting in all those verticals that I was mentioning or horizontal like sales and marketing, creative approaches. I'm seeing engineering adopt it much faster internally now with the CODI models, with the open source, it's a surprise, by the way, if I had to share my personal, I thought engineering was so productive and they're writing their right, just design elements of UX and the discussion you have around that. I've been there takes a long time. But then having a bot in the room saying, here's how you can approach it or here's how code could be written capabilities, it's fantastic to see that. So I see a lack of resources which was causing engineering projects to be bottlenecked. Now the transformation is going to be much faster. So bringing that across to vertical is like fantastic. That's the IP that's”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Not mistake, but We think deeply about the data that customers bring to our platform. And these are not mistakes, but we worry about any of this not being used in a way or something happens. So we take that very seriously. So we run a lot of drills. We make sure that data is kept secure. The models that are trained, even if there are early days, no leaks happen. The adapter model, the certification, everything stays in their tenant. So from the beginning, we just made sure that all of their data, all of their models, all of their weights, that's like their IP. And we want to safeguard that. So none of the mistakes, just deeply have to think about how fast we move and what are the checkpoints we need to make in between to make sure we don't move too fast that we get into mistakes. Those rollbacks are expensive, by the way. Then you have to again educate like the industry, make sure they understand rather not commit those is where I'm going.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Going up, which is to take time migration of systems, can we make that easier? There's a ton of use cases that are helpful. We're just bringing this forward on the platform.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Expensive part is now becoming cheap. The models, the availability, the usage of the platform, those were the things that were really expensive. I think if you do a cost craft curve right now and the investments you all are making into the ecosystem, I think we're seeing that just phenomenal coming down, which will allow people to adopt more. So I think we're really entering a phase of Serala and that like a growth phase of just people adopting this more and more. We are seeing signs of just like how fast can you do, how fast can we learn? We've had training classes and we've had people certified. I've never seen this for a year. We have more than 10,000 people certified now. On GCP generative AI globally, right? Ready to write code, take advantage of code capabilities, engineers, productivity.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, I think it goes back to kind of how much investment, how much belief, how much they want to be in the vision quadrant first of a kind versus fast follower all plays into it. It's less about the technology. It's more about like where they see themselves in the industry. And if they're seeing themselves as like, hey, we want to really build something and then scale out and then keep investing in it. I've spoken with a lot of customers, even governments and on the interest in AI, I have not seen this. It's so high. We have just scratched the surface of this right now. So we can see a lot of these gains which then can get invested back in the business. So I see a lot of positive signs around that.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Audio, and then you're kind of combining these medias together. So, as I said before, the trust on these as it increases, you're going to see multimodal coming forward. There are things to think about like identification, creation, deep fakes that get created, voices that are used, out of band, how can we provide that layer of safety around that, especially when it's used internally and the data and the creation becomes an element of cost. How do we store that? How do we retrieve that? How do we scale that? So if I give an example, I think gaming is a really good industry, which is kind of scaling out multimodality. And we have a lot of customers who are using that. Now think of that when you're going shopping and then the latency and the progress bar like, why can't I see the video coming, right? So that's why you see it centralized with some organizations who are experimenting, but we got to bring it at scale out, which will be like.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yes, so I think the core right now is language and text and conversation fits really well into it. Like what we're doing, can you convert it into a script and you do translations around it and you have a distribution mechanism? Sounds easy now, but it was really hard three, four years ago. Multimodal, I think we're early stages now. So you're going to see the early models which are audio-based. So I think about it like text than images that images and text”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“For my HR benefits and do this XYZ, why can't we make that easy, right? So we're seeing the internal process now, whether it's regulated or unregulated. And I think there are these huge areas that we can provide opportunity with AI. That's my belief.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, I see a lot of interest. It started from sales and marketing. Like as soon as these came out from a horizontal perspective, I think it's an intersection between horizontal and vertical for every department, whether regulated or regulated. There's like bottlenecks in content creation, distribution, all that became like you could see the efficiency gains immediately and creative gains. And then making that process and workflow shorter. So that was one customer care. You all touched on it is another one that goes vertical across horizontal, even if you are a B2B, you're touching a supplier. And a supplier wants a good experience with their current provider. So how can that experience get better? And then now we're seeing them verticalize on the internal experiences. So how do I make my employees experience better? So you're kind of seeing that same technology applied internally is like, oh my God, I'm looking.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“More and more, and the world we look at is like how are these things going to work in the system of intelligence or agents in the future that the trust goes up and then you really free up your human capital to be creative, right? So I think we're on that trust cycle of like how do we trust these models? They do what we are thinking. They don't go off. They don't hallucinate. All those things are important. So that's how we think about it. And then gradually make progress towards it and not get super excited and then find that the KPIs are not working, for example.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, it falls into like for me it's like efficiency, productivity gains and also creativity and I did it in order because inside the enterprise folks want to be creative but every time they think about efficiency games inside their workflows. So how can I make my workflow better so I can invest back into my group and then how can I make productivity better than I can make them creative? And I think we're seeing the flow inside the organizations. So what you touched on in Ad is right. How can I make my customers successful? Like let's start that use case. Efficiency, how can I make my support better and not drop my CSAT? That's the KPI I'm going to look at. And if that matches and I go into productivity gains, offering promotions, next recommendations, then the trust increases. So let's put another dimension there of trust. So now you have your efficiency. You're going into productivity. You trust.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, sure, sir. So we deeply think about it because you have to be responsible once you're building and fine-tuning a model, what are the guardrails, what are the use cases, what is the cost you want to put behind that because it's a continuous learning process. And it also depends on the maturity of the organization. Do they have a team that understands how models are built, tuned, and then brought forward? And it doesn't mean that you cannot invest in it. It's just that where you are in the cycle is very important. So we lean in, talk about that from a board level perspective, from a strategy perspective, and then thinking through cultural transformations as well. So it's not limited to just one dimension in my mind. And it really helps them to think through how they see this transformation also happening inside their organization.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Really answer our capability, you start thinking deeply about it inside an organization. So I see this as early excitement. It's not hype, so I want to decouple that. It's real excitement because engineers, we love it. Like I've been one, you want to grab something, you don't want to have restrictions around it, and you want to show the art of the possible. And I think from those experiments, we're going to see in the next year or so capabilities that are available to the users and to inside the enterprise where they will see differentiated output and capabilities. That's how I see it. So I'm excited in all those phases, by the way, because it's like the best creative time for engineers to solve problems that they've been thinking about solving for a while. And now they have the tools that they can download, whether they can grab an open source one, a closed one, and we can then kind of see how they're using.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Yeah, I think it's always the case if you look in history. It's like, hey, I got an API, I can build a prototype and it creates a lot of excitement. It's when you really start thinking about deploying it, managing it, monitoring it, using different models to chain them.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Variations coming onto the platform. But what's key, Lad in all of this is your data is secure. You want to be like fine-tuning it on the platform. And then all the model operation should be easy because we've spent a lot of time really specializing around the model drift, operations, tooling, safety around it, super early, but I think those are the elements that will differentiate on the platform from the next few quarters.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“And I think it's helpful to know that we have invested on the AI infrastructure. So you've seen people training not only using our first 40 models, but also training their models and bringing it on to our platform. The next level up is the vertex, what we call is capabilities of models that you can use from our model garden. That's where we have domain-specific models. So it's MedPom, SecPom. These are early days domain specific. You can chat with it. You can kind of get validation of things, the notes that are written out from a nurse to a patient healthcare from a doctor. And it kind of puts it in the right format that can be saved up. So it's early days. We are seeing it from just foundational model capabilities to models that are built by our users and deployed on our platform to also open source models. I'm really excited to see llama, stable diffusion, other”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Not going to predict because you predict something and something always comes back and surprises you from a technology perspective, from a modern perspective. So I'm looking forward to see what surprises you. And I'm sure we'll speak again in six months. And you'll be like, Gandhi, I saw this feature inside Gmail. It's really helpful. I like the translation feature for my mom because she speaks Hindi. She's really fluent in it. And when I write my emails now, I can just say translate this when she reads it. Now it does it automatically because she's using that app. So which is like fantastic. So I think it just bridges the gaps for a lot of our users internally and externally.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“I think we're seeing it across the board aha moments. As we launch, we're seeing it in documents in terms of generation summarization. We're seeing it now in slides with suggestions on images and new image creation, which is to take time for someone to go ask a studio or an agency and you have a prompt that you can give and say, here's something I'm thinking about. So Sarah, we've seen kind of intake on all those features. Also email, generation has been super helpful from productivity perspective. Not only for the consumers, but for enterprises as well. Security, we don't talk about it a lot. I think it's super secure how it's sent, how the links are used. Those are something we really take it seriously.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“The early ones, I think it's all public now, was around workspace, just using a documentation, our email. I'm sure use it. So it was like, can you summarize this better? Can you personalize this better? Can you offer me a suggestion? And all this kind of gradually as we tested it internally in dog food, we gradually launch it externally because we see a lot of progress that we make internally in terms of efficiency, productivity gains. Folks can use it in their spreadsheet creation, et cetera, was gradually launched. And now it's dual AI, part of workspace. These are constantly being dog food and tested. We call them experiments. And as a research team leans in and looks at some of these, we added to the platform and bring it forward in our products.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“As we were getting into the Google Cloud, this goes back into how can we provide them with latency high response, better experience with data is how our customers started kind of leaning towards Google, in my mind. From the beginning, it was more around machine learning and AI as a differentiator to work with Google. And how could they use that data better on our platform was a constant ask. So as we were on the journey of Google Cloud, it was all about data, AI, storage, privacy, security, and kind of having that same deep technology that we used inside Google. How could we leverage that and offer that in market? So lots of learnings because what we built internally, we had tools, frameworks, et cetera, that took us time to kind of make our platform rich for our customers.”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT
“Sure. I already worked deeply with a lot of our advertisers around search and ads for shopping and travel, especially commercial based queries. And as working with them, they required a lot of storage, compute, infrastructure, constantly around making their ads perform better, which led us to cloud and then cloud solutions around using some of that to create smart analytics, machine learning pipelines, more around documentation AI, conversational AI. And here we are. We've been doing it for a while, but now it's generative AI, where how can you make that customer experience much better with the information that they have?”
2023-10-23 · No Priors · What Google Cloud Can Teach Enterprises Developing & Rolling Out AI Tools, With Kawal Gandhi · IDENTIFIED FROM THE TRANSCRIPT