Full Transcript
Read or copy the complete episode transcript.
We are in the race for superintelligence We are in the race for superintelligence and Andrew Feldman is back and Andrew Feldman is back and Andrew Feldman is back and and and obviously CEO and founder of Cerebras obviously CEO and founder of Cerebras obviously CEO and founder of Cerebras doing inference chips pioneered the doing inference chips pioneered the doing inference chips pioneered the space had a successful IPO. We've talked space had a successful IPO. We've talked space had a successful IPO. We've talked about this a couple times. We got to see about this a couple times. We got to see about this a couple times. We got to see each other in January at Davos IPO each other in January at Davos IPO each other in January at Davos IPO happens. happens. happens. The boys and I got to sit with you The boys and I got to sit with you The boys and I got to sit with you recently. recently. recently. >> That was fun. >> That was fun. >> That was fun. >> at liquidity. >> at liquidity. >> at liquidity. >> That was really that was really fun. >> That was really that was really fun. >> That was really that was really fun. >> had a great discussion with the boys but >> had a great discussion with the boys but >> had a great discussion with the boys but I wanted to deep dive with you about I wanted to deep dive with you about I wanted to deep dive with you about a couple of topics. The first one is the a couple of topics. The first one is the a couple of topics. The first one is the build out of build out of build out of AI. AI. AI. We've never seen a build out like this We've never seen a build out like this We've never seen a build out like this since you know since you know since you know >> the Great Wall of China. >> the Great Wall of China. >> the Great Wall of China. >> Right, who knows since >> Right, who knows since >> Right, who knows since >> the pyramids. I mean it feels like >> the pyramids. I mean it feels like >> the pyramids. I mean it feels like the amount of capital, time, and the amount of capital, time, and the amount of capital, time, and intelligent people on the planet intelligent people on the planet intelligent people on the planet dedicating themselves to the build out dedicating themselves to the build out dedicating themselves to the build out of something. of something. of something. Um I can't think of anything in our Um I can't think of anything in our Um I can't think of anything in our lifetimes but perhaps you know before lifetimes but perhaps you know before lifetimes but perhaps you know before our lifetimes the war effort. our lifetimes the war effort. our lifetimes the war effort. >> Right. >> Right. >> Right. >> This is a mobilization at a scale that >> This is a mobilization at a scale that >> This is a mobilization at a scale that we read about, we hear about but you're we read about, we hear about but you're we read about, we hear about but you're actually doing it. You have customers actually doing it. You have customers actually doing it. You have customers who are building data centers and you're who are building data centers and you're who are building data centers and you're a key piece of that. >> AppLovin started with an $8 domain and >> AppLovin started with an $8 domain and no VC funding and became one of the no VC funding and became one of the no VC funding and became one of the largest ad platforms in the world. Now largest ad platforms in the world. Now largest ad platforms in the world. Now that same engine powers AppLovin ads for that same engine powers AppLovin ads for that same engine powers AppLovin ads for e-commerce. Your ads run inside mobile e-commerce. Your ads run inside mobile e-commerce. Your ads run inside mobile games reaching over a billion people games reaching over a billion people games reaching over a billion people with full screen distraction free with full screen distraction free with full screen distraction free attention. The platform finds buyers and attention. The platform finds buyers and attention. The platform finds buyers and optimizes for profit. You set the optimizes for profit. You set the optimizes for profit. You set the target, it does the rest. One cookware target, it does the rest. One cookware target, it does the rest. One cookware brand went from $4 million to $16 brand went from $4 million to $16 brand went from $4 million to $16 million turned profitable and is on pace million turned profitable and is on pace million turned profitable and is on pace for 80 million this year. Visit for 80 million this year. Visit for 80 million this year. Visit applovin.com/allin applovin.com/allin applovin.com/allin to launch your first campaign today. to launch your first campaign today. to launch your first campaign today. >> Maybe you could just enlighten us in >> Maybe you could just enlighten us in >> Maybe you could just enlighten us in 2026 what is Cerebras doing 2026 what is Cerebras doing 2026 what is Cerebras doing and what is happening with this build and what is happening with this build and what is happening with this build out in Texas, these are some gigantic out in Texas, these are some gigantic out in Texas, these are some gigantic gigantic efforts. gigantic efforts. gigantic efforts. >> The the size and scope of what is being >> The the size and scope of what is being >> The the size and scope of what is being built, physical size and scope. Usually built, physical size and scope. Usually built, physical size and scope. Usually when we talk about software or we talk when we talk about software or we talk when we talk about software or we talk about hardware, we're talking about about hardware, we're talking about about hardware, we're talking about chips and boxes and and they don't have chips and boxes and and they don't have chips and boxes and and they don't have the same sort of physical enormity. the same sort of physical enormity. the same sort of physical enormity. >> Right. >> Right. >> Right. >> Right. And what we're talking about now >> Right. And what we're talking about now >> Right. And what we're talking about now are data centers that are in the next are data centers that are in the next are data centers that are in the next several years going to use more power several years going to use more power several years going to use more power than the previous 50 years on Earth than the previous 50 years on Earth than the previous 50 years on Earth took. took. took. >> Wow. >> Wow. >> Wow. >> Right. We're talking about individual >> Right. We're talking about individual >> Right. We're talking about individual buildings the size of football fields buildings the size of football fields buildings the size of football fields that have more power coming into them that have more power coming into them that have more power coming into them than midsize cities. than midsize cities. than midsize cities. And they're being built they're being And they're being built they're being And they're being built they're being built across the US. They're being built built across the US. They're being built built across the US. They're being built in Canada. They're being built in Canada. They're being built in Canada. They're being built throughout the Nordics. They're being throughout the Nordics. They're being throughout the Nordics. They're being built here in Paris and throughout built here in Paris and throughout built here in Paris and throughout France and Europe and the Middle East in France and Europe and the Middle East in France and Europe and the Middle East in nations that sort of [snorts] weren't nations that sort of [snorts] weren't nations that sort of [snorts] weren't front and center in anybody's mind front and center in anybody's mind front and center in anybody's mind previously, you know, Kazakhstan, previously, you know, Kazakhstan, previously, you know, Kazakhstan, Tajikistan or building out Georgia Tajikistan or building out Georgia Tajikistan or building out Georgia building out data centers of size, building out data centers of size, building out data centers of size, Armenia. Armenia. Armenia. Everybody's sort of focused huge data Everybody's sort of focused huge data Everybody's sort of focused huge data centers. centers. centers. >> um and every state obviously in America >> um and every state obviously in America >> um and every state obviously in America feels they need to participate in this. feels they need to participate in this. feels they need to participate in this. And the people who are buying the And the people who are buying the And the people who are buying the capacity, the OpenAIs, Anthropic, SpaceX capacity, the OpenAIs, Anthropic, SpaceX capacity, the OpenAIs, Anthropic, SpaceX I SpaceX AI I SpaceX AI I SpaceX AI uh the Googles, uh the Googles, uh the Googles, they are insatiable right now. they are insatiable right now. they are insatiable right now. >> Yeah. >> Yeah. >> Yeah. And [clears throat] they're building how And [clears throat] they're building how And [clears throat] they're building how many years out? When you talk to them many years out? When you talk to them many years out? When you talk to them they were ordering chips from Cerebrus they were ordering chips from Cerebrus they were ordering chips from Cerebrus before you were finished with the chips. before you were finished with the chips. before you were finished with the chips. They're putting orders in ahead of time. They're putting orders in ahead of time. They're putting orders in ahead of time. >> The irony is unlike many sort of >> The irony is unlike many sort of >> The irony is unlike many sort of exciting times in technology, th- exciting times in technology, th- exciting times in technology, th- they're trying to capture yesterday's they're trying to capture yesterday's they're trying to capture yesterday's demand, right? The demand is way demand, right? The demand is way demand, right? The demand is way outstripping our ability to build data outstripping our ability to build data outstripping our ability to build data centers and to fill them with hardware. centers and to fill them with hardware. centers and to fill them with hardware. All right. And so, you know, we have a All right. And so, you know, we have a All right. And so, you know, we have a $25 billion backlog. $25 billion backlog. $25 billion backlog. >> $25 billion backlog. >> $25 billion backlog. >> $25 billion backlog. >> [snorts] >> [snorts] >> [snorts] >> And we we are not alone in that. Open >> And we we are not alone in that. Open >> And we we are not alone in that. Open AI, Anthropic, you go through this list AI, Anthropic, you go through this list AI, Anthropic, you go through this list of of of of of of Google wants more data centers, Google wants more data centers, Google wants more data centers, Microsoft wants more data centers, AWS Microsoft wants more data centers, AWS Microsoft wants more data centers, AWS wants more data centers, right? All of wants more data centers, right? All of wants more data centers, right? All of these players are not chasing sort of if these players are not chasing sort of if these players are not chasing sort of if you build it, they will come. They're you build it, they will come. They're you build it, they will come. They're chasing the demand is booked. chasing the demand is booked. chasing the demand is booked. >> Right. [laughter] >> Right. [laughter] >> Right. [laughter] >> How do we keep them from leaving? >> How do we keep them from leaving? >> How do we keep them from leaving? >> Right. >> Right. >> Right. >> And and that that's extremely unusual. >> And and that that's extremely unusual. >> And and that that's extremely unusual. >> It's very unusual and now we have people >> It's very unusual and now we have people >> It's very unusual and now we have people who are you know, we have a term for a who are you know, we have a term for a who are you know, we have a term for a token maxing. token maxing. token maxing. >> Yeah. >> Yeah. >> Yeah. >> And there's a great debate, is this >> And there's a great debate, is this >> And there's a great debate, is this actually creating value? actually creating value? actually creating value? I'm curious where you stand. I'm curious where you stand. I'm curious where you stand. You know, is it even possible that this You know, is it even possible that this You know, is it even possible that this much demand could be created if value much demand could be created if value much demand could be created if value did not exist? There is clearly massive did not exist? There is clearly massive did not exist? There is clearly massive value happening. value happening. value happening. >> Yeah. >> Yeah. >> Yeah. >> But there's also massive >> But there's also massive >> But there's also massive experimentation. experimentation. experimentation. >> Oh, for sure. You know, I >> Oh, for sure. You know, I >> Oh, for sure. You know, I You know, what I I I liken this to when You know, what I I I liken this to when You know, what I I I liken this to when we first started with AWS we first started with AWS we first started with AWS and it was so good to get around your and it was so good to get around your and it was so good to get around your own IT organization. own IT organization. own IT organization. >> Right. >> Right. >> Right. >> That you told every engineer, yeah, go >> That you told every engineer, yeah, go >> That you told every engineer, yeah, go ahead, put it on your credit card, sign ahead, put it on your credit card, sign ahead, put it on your credit card, sign up. up. up. >> Yeah. >> Yeah. >> Yeah. >> Right? And a lot of it was really useful >> Right? And a lot of it was really useful >> Right? And a lot of it was really useful and some of it was like, God, I wish we and some of it was like, God, I wish we and some of it was like, God, I wish we didn't do that. didn't do that. didn't do that. >> Yeah. >> Yeah. >> Yeah. >> And so, for sure, there's >> And so, for sure, there's >> And so, for sure, there's experimentation. experimentation. experimentation. But But But it doesn't mean that that the net value it doesn't mean that that the net value it doesn't mean that that the net value isn't enormous. It it means some of it isn't enormous. It it means some of it isn't enormous. It it means some of it is going to go nowhere. is going to go nowhere. is going to go nowhere. And you know, it was the same I remember And you know, it was the same I remember And you know, it was the same I remember when Costco opened up in in in in the when Costco opened up in in in in the when Costco opened up in in in in the Palo Alto area in 1988 and people used Palo Alto area in 1988 and people used Palo Alto area in 1988 and people used to shop Costco like they shop Safeway. to shop Costco like they shop Safeway. to shop Costco like they shop Safeway. They'd go down every aisle. They'd go down every aisle. They'd go down every aisle. >> Yes. >> Yes. >> Yes. >> That's a horrible way to shop Costco cuz >> That's a horrible way to shop Costco cuz >> That's a horrible way to shop Costco cuz you end up with four things you didn't you end up with four things you didn't you end up with four things you didn't need and each was $22. Right? And as need and each was $22. Right? And as need and each was $22. Right? And as people got more sort of accustomed to people got more sort of accustomed to people got more sort of accustomed to it, you go to the back, you get the it, you go to the back, you get the it, you go to the back, you get the chicken. chicken. chicken. >> Yeah. >> Yeah. >> Yeah. >> 18 cupcakes for the kids' birthday >> 18 cupcakes for the kids' birthday >> 18 cupcakes for the kids' birthday party. party. party. >> Bang, you were out. >> Bang, you were out. >> Bang, you were out. >> Strategic. Strategic. And it's exactly >> Strategic. Strategic. And it's exactly >> Strategic. Strategic. And it's exactly the same. I think at first people opened the same. I think at first people opened the same. I think at first people opened up and said, "Everybody as much tokens up and said, "Everybody as much tokens up and said, "Everybody as much tokens as you want." And the in enterprises, as you want." And the in enterprises, as you want." And the in enterprises, there's no open loop. We don't give sort there's no open loop. We don't give sort there's no open loop. We don't give sort of any resource unconstrained to people. of any resource unconstrained to people. of any resource unconstrained to people. And now we're jumping on and saying, And now we're jumping on and saying, And now we're jumping on and saying, "Whoa, all right. These guys should have "Whoa, all right. These guys should have "Whoa, all right. These guys should have as much as they need. They're enormously as much as they need. They're enormously as much as they need. They're enormously productive. Over here we can use maybe productive. Over here we can use maybe productive. Over here we can use maybe an open-source model, maybe a cheaper an open-source model, maybe a cheaper an open-source model, maybe a cheaper model over here." And now we're sort of model over here." And now we're sort of model over here." And now we're sort of running like a business. running like a business. running like a business. >> And and >> And and >> And and we're really seeing we're really seeing we're really seeing a certain type of person emerge who a certain type of person emerge who a certain type of person emerge who knows how to deploy this technology. knows how to deploy this technology. knows how to deploy this technology. Systems thinking. Systems thinking. Systems thinking. >> Yeah. >> Yeah. >> Yeah. >> Which developers kind of have innately. >> Which developers kind of have innately. >> Which developers kind of have innately. CEOs tend to be great strategists and CEOs tend to be great strategists and CEOs tend to be great strategists and understand systems. understand systems. understand systems. Uh but this the intelligence is getting Uh but this the intelligence is getting Uh but this the intelligence is getting so much better every step along the way so much better every step along the way so much better every step along the way that I'm watching individuals, typically that I'm watching individuals, typically that I'm watching individuals, typically startup founders, but also venture startup founders, but also venture startup founders, but also venture capitalists and and associates who work capitalists and and associates who work capitalists and and associates who work at my venture firm, at my venture firm, at my venture firm, they start playing with the tool, and they start playing with the tool, and they start playing with the tool, and then the tool starts playing with them. then the tool starts playing with them. then the tool starts playing with them. They start to go, "Oh, They start to go, "Oh, They start to go, "Oh, I haven't clearly defined what my goal I haven't clearly defined what my goal I haven't clearly defined what my goal is. I don't understand what a system is. is. I don't understand what a system is. is. I don't understand what a system is. I don't under I've never heard about I don't under I've never heard about I don't under I've never heard about making a requirements document." And the making a requirements document." And the making a requirements document." And the software's like, "Do you have a software's like, "Do you have a software's like, "Do you have a requirements document? What's your requirements document? What's your requirements document? What's your goal?" goal?" goal?" >> [laughter] >> [laughter] >> [laughter] >> The AI starts telling people you're >> The AI starts telling people you're >> The AI starts telling people you're token maxing and you need to get a token maxing and you need to get a token maxing and you need to get a little more focused here. little more focused here. little more focused here. >> One of one of my colleagues 20 years >> One of one of my colleagues 20 years >> One of one of my colleagues 20 years ago, a really smart smart computer ago, a really smart smart computer ago, a really smart smart computer scientist, said, "Computer's really scientist, said, "Computer's really scientist, said, "Computer's really dumb. dumb. dumb. They they do exactly what you tell They they do exactly what you tell They they do exactly what you tell them." them." them." >> Yeah. >> Yeah. >> Yeah. >> And at first prompting was like that. >> And at first prompting was like that. >> And at first prompting was like that. Right? You modified your prompt a little Right? You modified your prompt a little Right? You modified your prompt a little bit and it changed the answer. bit and it changed the answer. bit and it changed the answer. >> Dramatically. >> Dramatically. >> Dramatically. >> Dramatically. And increasingly, >> Dramatically. And increasingly, >> Dramatically. And increasingly, it's understanding what your intent was. it's understanding what your intent was. it's understanding what your intent was. >> Right. >> Right. >> Right. >> Right. And if you if you have a chance >> Right. And if you if you have a chance >> Right. And if you if you have a chance to to to play with Fable or or 5/6 from to to to play with Fable or or 5/6 from to to to play with Fable or or 5/6 from from Open AI, increasingly what from Open AI, increasingly what from Open AI, increasingly what you don't have to get the prompt just you don't have to get the prompt just you don't have to get the prompt just right. You don't have to be a prompt right. You don't have to be a prompt right. You don't have to be a prompt whisper. Instead, you ask it and it whisper. Instead, you ask it and it whisper. Instead, you ask it and it says, "Well, here's some things and and says, "Well, here's some things and and says, "Well, here's some things and and by the way, maybe you wanted the chart by the way, maybe you wanted the chart by the way, maybe you wanted the chart to to to go two ways. You wanted it to to to go two ways. You wanted it to to to go two ways. You wanted it aligned in a bar." And it's like, "Well, aligned in a bar." And it's like, "Well, aligned in a bar." And it's like, "Well, that's exactly what I wanted. I didn't that's exactly what I wanted. I didn't that's exactly what I wanted. I didn't ask for it, but that is better." ask for it, but that is better." ask for it, but that is better." And and so it's it's understanding And and so it's it's understanding And and so it's it's understanding intent, and that's a huge leap. intent, and that's a huge leap. intent, and that's a huge leap. >> Which, if we were sitting here two years >> Which, if we were sitting here two years >> Which, if we were sitting here two years ago, the idea ago, the idea ago, the idea we would never have been able to predict we would never have been able to predict we would never have been able to predict in a short 24 months that it would go in a short 24 months that it would go in a short 24 months that it would go from being a great summarizer researcher from being a great summarizer researcher from being a great summarizer researcher of web results of web results of web results >> Right. >> Right. >> Right. >> to actually understanding your intent >> to actually understanding your intent >> to actually understanding your intent and then providing a solution and and then providing a solution and and then providing a solution and abstracting it all from you. abstracting it all from you. abstracting it all from you. >> That's right. That's right. >> That's right. That's right. >> That's right. That's right. >> Which is a very weird thing. I I don't >> Which is a very weird thing. I I don't >> Which is a very weird thing. I I don't know if you've played with the Hermes know if you've played with the Hermes know if you've played with the Hermes agent yet. agent yet. agent yet. Have you played with it yet? I mean, Have you played with it yet? I mean, Have you played with it yet? I mean, I asked it I asked it I asked it just this morning, uh and I I was given just this morning, uh and I I was given just this morning, uh and I I was given a secret BitTensor project that has the a secret BitTensor project that has the a secret BitTensor project that has the new um ZAI's new um ZAI's new um ZAI's uh model 5/2. uh model 5/2. uh model 5/2. >> And they gave me GLM 5/2, yeah. >> And they gave me GLM 5/2, yeah. >> And they gave me GLM 5/2, yeah. >> GLM 5/2. So, somebody in that BitTensor >> GLM 5/2. So, somebody in that BitTensor >> GLM 5/2. So, somebody in that BitTensor I don't think you understand BitTensor, I don't think you understand BitTensor, I don't think you understand BitTensor, you've heard of it, the distributed you've heard of it, the distributed you've heard of it, the distributed um um um crypto project. And so, they have all crypto project. And so, they have all crypto project. And so, they have all this extra capacity. this extra capacity. this extra capacity. I was a whisperer told me, probably some I was a whisperer told me, probably some I was a whisperer told me, probably some capacity in China that has free energy. capacity in China that has free energy. capacity in China that has free energy. Okay, fine. Okay, fine. Okay, fine. So, they gave me unlimited capacity, so So, they gave me unlimited capacity, so So, they gave me unlimited capacity, so I started having to do some really crazy I started having to do some really crazy I started having to do some really crazy jobs jobs jobs where I was saying like, "Every hour I where I was saying like, "Every hour I where I was saying like, "Every hour I want you to tell me what the trends in want you to tell me what the trends in want you to tell me what the trends in the world are that nobody else has the world are that nobody else has the world are that nobody else has identified yet. And you can do whatever identified yet. And you can do whatever identified yet. And you can do whatever you want to do that, but my goal is to you want to do that, but my goal is to you want to do that, but my goal is to be the smartest trend hunter in the be the smartest trend hunter in the be the smartest trend hunter in the world." And I watched what it was doing world." And I watched what it was doing world." And I watched what it was doing in the background, and it started in the background, and it started in the background, and it started debating itself on where it should find debating itself on where it should find debating itself on where it should find the things. It said, "Well, we should the things. It said, "Well, we should the things. It said, "Well, we should probably go to Hacker News and Reddit." probably go to Hacker News and Reddit." probably go to Hacker News and Reddit." And then it was like, "Yeah, but there's And then it was like, "Yeah, but there's And then it was like, "Yeah, but there's also social media, and trends tend to also social media, and trends tend to also social media, and trends tend to manifest on Instagram." manifest on Instagram." manifest on Instagram." >> That's a reasoning model. You were >> That's a reasoning model. You were >> That's a reasoning model. You were watching a reasoning model work out. watching a reasoning model work out. watching a reasoning model work out. >> Yeah. >> Yeah. >> Yeah. >> Isn't that interesting? I mean, that's >> Isn't that interesting? I mean, that's >> Isn't that interesting? I mean, that's amazing. amazing. amazing. >> And and >> And and >> And and it was collapsed. So, as a civilian it was collapsed. So, as a civilian it was collapsed. So, as a civilian >> Right. >> Right. >> Right. >> who doesn't hit the uncollapsed moment, >> who doesn't hit the uncollapsed moment, >> who doesn't hit the uncollapsed moment, and if you were using ChatGPT 3.5 or you and if you were using ChatGPT 3.5 or you and if you were using ChatGPT 3.5 or you were using 4.8, whatever it was, and you were using 4.8, whatever it was, and you were using 4.8, whatever it was, and you haven't used this new level of haven't used this new level of haven't used this new level of >> Right. >> Right. >> Right. >> reasoning and inference and unlimited >> reasoning and inference and unlimited >> reasoning and inference and unlimited compute, essentially. compute, essentially. compute, essentially. >> Right. >> Right. >> Right. >> It opened my eyes just this morning >> It opened my eyes just this morning >> It opened my eyes just this morning of what a world of what a world of what a world of unlimited tokens might look like. of unlimited tokens might look like. of unlimited tokens might look like. >> Right. >> Right. >> Right. >> Cuz unlimited tokens, I believe, means >> Cuz unlimited tokens, I believe, means >> Cuz unlimited tokens, I believe, means unlimited reasoning. unlimited reasoning. unlimited reasoning. >> It does. >> It does. >> It does. What does that mean? What does that mean? What does that mean? >> Yeah. It's uh I mean, >> Yeah. It's uh I mean, >> Yeah. It's uh I mean, if you run these for 25 or 48 hours, you if you run these for 25 or 48 hours, you if you run these for 25 or 48 hours, you get amazing things now. get amazing things now. get amazing things now. And what what if by using Cerebras we And what what if by using Cerebras we And what what if by using Cerebras we were 15 times faster, and then you ran were 15 times faster, and then you ran were 15 times faster, and then you ran it for 24 hours? it for 24 hours? it for 24 hours? >> Right. >> Right. >> Right. >> And you got weeks or [clears throat] >> And you got weeks or [clears throat] >> And you got weeks or [clears throat] months worth of thinking. months worth of thinking. months worth of thinking. >> Yeah. >> Yeah. >> Yeah. >> And I mean, it it is uh it is >> And I mean, it it is uh it is >> And I mean, it it is uh it is extraordinary. And I I think one of the extraordinary. And I I think one of the extraordinary. And I I think one of the things is people like Ilya and Sam in things is people like Ilya and Sam in things is people like Ilya and Sam in the early days were saying this was the early days were saying this was the early days were saying this was coming. coming. coming. >> Right. >> Right. >> Right. >> Right. And I think when you look back, >> Right. And I think when you look back, >> Right. And I think when you look back, you say to yourself, "Holy crap. Those you say to yourself, "Holy crap. Those you say to yourself, "Holy crap. Those guys guys guys >> They knew. >> They knew. >> They knew. >> saw it. >> saw it. >> saw it. >> Yeah, they were They could see around >> Yeah, they were They could see around >> Yeah, they were They could see around the corner. the corner. the corner. >> That's right. And the rest of us were >> That's right. And the rest of us were >> That's right. And the rest of us were like, "What? I'm not sure." like, "What? I'm not sure." like, "What? I'm not sure." >> It's when we had Sam on all in uh at one >> It's when we had Sam on all in uh at one >> It's when we had Sam on all in uh at one point, he uh and he said, "Oh, you know, point, he uh and he said, "Oh, you know, point, he uh and he said, "Oh, you know, I'd love to come on at some point." I I'd love to come on at some point." I I'd love to come on at some point." I said, "Sure, come on." And he was said, "Sure, come on." And he was said, "Sure, come on." And he was talking about it, and he said, talking about it, and he said, talking about it, and he said, you know, I said, "What's next?" He you know, I said, "What's next?" He you know, I said, "What's next?" He said, "Reasoning." I said, "Unpack that. said, "Reasoning." I said, "Unpack that. said, "Reasoning." I said, "Unpack that. What does it mean?" He's like, "Well, What does it mean?" He's like, "Well, What does it mean?" He's like, "Well, understanding what your intent was, just understanding what your intent was, just understanding what your intent was, just as you're saying, and then figuring out as you're saying, and then figuring out as you're saying, and then figuring out a strategy, and then maybe talking to a strategy, and then maybe talking to a strategy, and then maybe talking to other agents and other threads about other agents and other threads about other agents and other threads about like, is this the right thing to do, and like, is this the right thing to do, and like, is this the right thing to do, and vetting each other's work." And I'm vetting each other's work." And I'm vetting each other's work." And I'm like, "Wow, we have come a long way from like, "Wow, we have come a long way from like, "Wow, we have come a long way from guess the next word." guess the next word." guess the next word." >> Right. Right. Right. Fill the sentence >> Right. Right. Right. Fill the sentence >> Right. Right. Right. Fill the sentence in, you know, summarize this PDF. in, you know, summarize this PDF. in, you know, summarize this PDF. >> Now, Cerebras is at the center of this >> Now, Cerebras is at the center of this >> Now, Cerebras is at the center of this because this reasoning is inference. because this reasoning is inference. because this reasoning is inference. >> This reasoning is inference and it's >> This reasoning is inference and it's >> This reasoning is inference and it's computationally intensive. computationally intensive. computationally intensive. >> Right. >> Right. >> Right. >> Right. And so, fast compute makes this >> Right. And so, fast compute makes this >> Right. And so, fast compute makes this sort of work fast and sort of tractable. sort of work fast and sort of tractable. sort of work fast and sort of tractable. It doesn't it by taking a huge It doesn't it by taking a huge It doesn't it by taking a huge amount of time to get a good answer. amount of time to get a good answer. amount of time to get a good answer. And so, it's exactly the fact that that And so, it's exactly the fact that that And so, it's exactly the fact that that that this reasoning consumes a huge that this reasoning consumes a huge that this reasoning consumes a huge amount of tokens internally amount of tokens internally amount of tokens internally that allows a a blisteringly fast that allows a a blisteringly fast that allows a a blisteringly fast machine like ours and I I brought one machine like ours and I I brought one machine like ours and I I brought one >> Oh, you >> Oh, you >> Oh, you >> I I'm never far without, you know, when >> I I'm never far without, you know, when >> I I'm never far without, you know, when one costs half a billion to make, you one costs half a billion to make, you one costs half a billion to make, you you bring it everywhere with you. you bring it everywhere with you. you bring it everywhere with you. >> And we we were we were tossing this back >> And we we were we were tossing this back >> And we we were we were tossing this back and forth at Davos. and forth at Davos. and forth at Davos. Uh what's the model number of this one? Uh what's the model number of this one? Uh what's the model number of this one? >> This was in the first eight or 10. >> This was in the first eight or 10. >> This was in the first eight or 10. >> Got it. >> Got it. >> Got it. So, this has a special place. So, this has a special place. So, this has a special place. >> This has a special place. I mean, my >> This has a special place. I mean, my >> This has a special place. I mean, my wife says it's like I'm a kid with a a wife says it's like I'm a kid with a a wife says it's like I'm a kid with a a dirt bike for his eighth birthday. He's dirt bike for his eighth birthday. He's dirt bike for his eighth birthday. He's in his bedroom at night. I I carry him in his bedroom at night. I I carry him in his bedroom at night. I I carry him with me. with me. with me. >> I I mean, when you have >> I I mean, when you have >> I I mean, when you have you know, your your next party at the you know, your your next party at the you know, your your next party at the house, I highly recommend just a little house, I highly recommend just a little house, I highly recommend just a little hors d'oeuvres something. hors d'oeuvres something. hors d'oeuvres something. I think it'd be like a great fit. It I think it'd be like a great fit. It I think it'd be like a great fit. It would be a great fit if you had some would be a great fit if you had some would be a great fit if you had some >> That's right. [laughter] >> That's right. [laughter] >> That's right. [laughter] >> Um but what we're looking at here is the >> Um but what we're looking at here is the >> Um but what we're looking at here is the ability to do that reasoning at scale ability to do that reasoning at scale ability to do that reasoning at scale and and and what is Moore's law what is Moore's law what is Moore's law for inference and for Cerebras? Do you for inference and for Cerebras? Do you for inference and for Cerebras? Do you have something internally you discuss as have something internally you discuss as have something internally you discuss as ev- we're going to double this every x ev- we're going to double this every x ev- we're going to double this every x time period? time period? time period? >> So, >> So, >> So, all chips prior to us in the processor all chips prior to us in the processor all chips prior to us in the processor world followed Moore's law. world followed Moore's law. world followed Moore's law. >> Got it. >> Got it. >> Got it. >> And we broke it >> And we broke it >> And we broke it >> Doubling every 18 months. >> Doubling every 18 months. >> Doubling every 18 months. >> Doubling about every 18 months. >> Doubling about every 18 months. >> Doubling about every 18 months. >> Got it. >> Got it. >> Got it. >> Um and we crushed it with this chip >> Um and we crushed it with this chip >> Um and we crushed it with this chip and we've carved out a whole new and we've carved out a whole new and we've carved out a whole new trajectory. trajectory. trajectory. And uh my view is in the next 18 months And uh my view is in the next 18 months And uh my view is in the next 18 months will be way over 2x. will be way over 2x. will be way over 2x. >> Interesting. >> Interesting. >> Interesting. >> And so >> And so >> And so I I think that early in an architecture I I think that early in an architecture I I think that early in an architecture you have room to do much better than you have room to do much better than you have room to do much better than what was traditionally Moore's law. Now what was traditionally Moore's law. Now what was traditionally Moore's law. Now if you've got a 20-year-old architecture if you've got a 20-year-old architecture if you've got a 20-year-old architecture like the GPU it's much harder. like the GPU it's much harder. like the GPU it's much harder. >> Right. >> Right. >> Right. >> You have to rely on things like smaller >> You have to rely on things like smaller >> You have to rely on things like smaller geometry. geometry. geometry. >> Mhm. >> Mhm. >> Mhm. >> Right, going to the next fab node. But >> Right, going to the next fab node. But >> Right, going to the next fab node. But in a newer architecture you have a huge in a newer architecture you have a huge in a newer architecture you have a huge amount of room still amount of room still amount of room still to to learn about the work that that is to to learn about the work that that is to to learn about the work that that is being presented and make optimizations being presented and make optimizations being presented and make optimizations that that give you huge gains. that that give you huge gains. that that give you huge gains. >> How do you run the company? Like just >> How do you run the company? Like just >> How do you run the company? Like just being the CEO now in the age of AI being the CEO now in the age of AI being the CEO now in the age of AI um [snorts] um [snorts] um [snorts] you have $25 billion in demand. You have you have $25 billion in demand. You have you have $25 billion in demand. You have to you have to deploy at an just an to you have to deploy at an just an to you have to deploy at an just an incredible blistering pace. incredible blistering pace. incredible blistering pace. You have to hire people. You have to You have to hire people. You have to You have to hire people. You have to create a road map. I don't mean to give create a road map. I don't mean to give create a road map. I don't mean to give you a panic attack here. you a panic attack here. you a panic attack here. >> You have to keep up with somebody like >> You have to keep up with somebody like >> You have to keep up with somebody like Open AI who's moving so unbelievably Open AI who's moving so unbelievably Open AI who's moving so unbelievably quickly. quickly. quickly. >> Yes. >> Yes. >> Yes. >> Right? And they're they're competing. >> Right? And they're they're competing. >> Right? And they're they're competing. You got to keep up. You got to keep up. You got to keep up. >> Right. >> Right. >> Right. >> Right? Your hardware, your software, >> Right? Your hardware, your software, >> Right? Your hardware, your software, your deployments have to keep up with your deployments have to keep up with your deployments have to keep up with some of the fastest moving organizations some of the fastest moving organizations some of the fastest moving organizations in history. in history. in history. >> They're demanding customers. >> They're demanding customers. >> They're demanding customers. They are not They are not They are not >> They're not pushovers for sure. >> They're not pushovers for sure. >> They're not pushovers for sure. >> Yeah. And >> Yeah. And >> Yeah. And also potentially competitors down the also potentially competitors down the also potentially competitors down the road. road. road. >> Look, I think there's so much demand >> Look, I think there's so much demand >> Look, I think there's so much demand right now right now right now that that that that that that there is no silicon that will go unused. there is no silicon that will go unused. there is no silicon that will go unused. >> Right. >> Right. >> Right. >> But why isn't Open AI releasing >> But why isn't Open AI releasing >> But why isn't Open AI releasing jalapeno? Why is Amazon making their own jalapeno? Why is Amazon making their own jalapeno? Why is Amazon making their own chips? You see this recurring trend. Is chips? You see this recurring trend. Is chips? You see this recurring trend. Is it a way to let you know, to let Jensen it a way to let you know, to let Jensen it a way to let you know, to let Jensen and Nvidia know, hey we can do this too. and Nvidia know, hey we can do this too. and Nvidia know, hey we can do this too. So we need good pricing. Is it is it a So we need good pricing. Is it is it a So we need good pricing. Is it is it a little bit of a flex that way or is that little bit of a flex that way or is that little bit of a flex that way or is that the future that they're going to be in the future that they're going to be in the future that they're going to be in your business. your business. your business. >> No, I I I think nobody likes being >> No, I I I think nobody likes being >> No, I I I think nobody likes being dependent. dependent. dependent. >> And I I think some of the lessons >> And I I think some of the lessons >> And I I think some of the lessons learned by the the hyperscalers of the learned by the the hyperscalers of the learned by the the hyperscalers of the x86 world is they were dependent on x86 world is they were dependent on x86 world is they were dependent on Intel. Intel. Intel. >> Mhm. >> Mhm. >> Mhm. >> And uh some of the lessons learned by >> And uh some of the lessons learned by >> And uh some of the lessons learned by uh the GPU makers uh the GPU makers uh the GPU makers was they were dependent on a small was they were dependent on a small was they were dependent on a small number of hyperscalers. number of hyperscalers. number of hyperscalers. >> Yeah. >> Yeah. >> Yeah. >> And they wanted more customers. And so >> And they wanted more customers. And so >> And they wanted more customers. And so they set about to to help fund these neo they set about to to help fund these neo they set about to to help fund these neo clouds. clouds. clouds. >> Mhm. >> Mhm. >> Mhm. >> And so I I think mostly it's about uh an >> And so I I think mostly it's about uh an >> And so I I think mostly it's about uh an opportunity to control at least an opportunity to control at least an opportunity to control at least an important part of your destiny. important part of your destiny. important part of your destiny. >> Got it. >> Got it. >> Got it. >> And I I think that's a very reasonable >> And I I think that's a very reasonable >> And I I think that's a very reasonable thing. I think you don't have to sort of thing. I think you don't have to sort of thing. I think you don't have to sort of make the fastest chip. You you just make the fastest chip. You you just make the fastest chip. You you just can't be entirely dependent on other can't be entirely dependent on other can't be entirely dependent on other people's chips. people's chips. people's chips. >> And that dependency has become a hot >> And that dependency has become a hot >> And that dependency has become a hot topic. Um not sure if you caught the topic. Um not sure if you caught the topic. Um not sure if you caught the episodes over the last 2 weeks, but episodes over the last 2 weeks, but episodes over the last 2 weeks, but we've been talking over the last year we've been talking over the last year we've been talking over the last year about open source. I've been championing about open source. I've been championing about open source. I've been championing that a lot. Just because I was early that a lot. Just because I was early that a lot. Just because I was early into open claw and quickly started using into open claw and quickly started using into open claw and quickly started using Kimmy and was like, "Wait a second. Kimmy and was like, "Wait a second. Kimmy and was like, "Wait a second. I'm blowing out my claw tokens, but this I'm blowing out my claw tokens, but this I'm blowing out my claw tokens, but this Kimmy, I can't tell the difference." Kimmy, I can't tell the difference." Kimmy, I can't tell the difference." And then we started smart routing it. And then we started smart routing it. And then we started smart routing it. And suddenly this open source And suddenly this open source And suddenly this open source started to figure out reasoning and the started to figure out reasoning and the started to figure out reasoning and the gap gap gap as as as >> Well, >> Well, >> Well, >> suddenly closed this year. >> suddenly closed this year. >> suddenly closed this year. >> Well, I I you know, you you >> Well, I I you know, you you >> Well, I I you know, you you you don't want to take your your Ferrari you don't want to take your your Ferrari you don't want to take your your Ferrari to the grocery store. to the grocery store. to the grocery store. Right. You you you there there are times Right. You you you there there are times Right. You you you there there are times you want to drive your fun car. you want to drive your fun car. you want to drive your fun car. >> Yeah. >> Yeah. >> Yeah. >> Right? And there times you you want to >> Right? And there times you you want to >> Right? And there times you you want to throw the kids in and and don't worry if throw the kids in and and don't worry if throw the kids in and and don't worry if there's Cheerios on the floor. there's Cheerios on the floor. there's Cheerios on the floor. >> Minivan time. >> Minivan time. >> Minivan time. >> Right. There's minivan time. And I and >> Right. There's minivan time. And I and >> Right. There's minivan time. And I and and I think that as the sort of and I think that as the sort of and I think that as the sort of sophistication of the user grows, right? sophistication of the user grows, right? sophistication of the user grows, right? You you're going to have hard problems You you're going to have hard problems You you're going to have hard problems and those are going to be frontier model and those are going to be frontier model and those are going to be frontier model problems. They're going to be open AI problems. They're going to be open AI problems. They're going to be open AI problems. They're going to be Anthropic problems. They're going to be Anthropic problems. They're going to be Anthropic problems. They're going to be Gemini problems. They're going to be Gemini problems. They're going to be Gemini problems. And behind that, they're going problems. And behind that, they're going problems. And behind that, they're going to be a lot of ordinary problems. Right? to be a lot of ordinary problems. Right? to be a lot of ordinary problems. Right? I mean, if you think about a company, I mean, if you think about a company, I mean, if you think about a company, you know how much time is spent cutting you know how much time is spent cutting you know how much time is spent cutting things out of work day and getting it in things out of work day and getting it in things out of work day and getting it in a different cell for a different cell for a different cell for >> Yeah. >> Yeah. >> Yeah. >> Right? Think about >> Right? Think about >> Right? Think about >> The cutting and pasting economy is real. >> The cutting and pasting economy is real. >> The cutting and pasting economy is real. Yeah. Yeah. Yeah. >> That's right. And And this doesn't need, >> That's right. And And this doesn't need, >> That's right. And And this doesn't need, right, gold medal math. right, gold medal math. right, gold medal math. >> No. >> No. >> No. >> What what this needs is sort of >> What what this needs is sort of >> What what this needs is sort of rock-solid open-source capabilities. rock-solid open-source capabilities. rock-solid open-source capabilities. >> Yeah. >> Yeah. >> Yeah. >> And if you think about what I mean, >> And if you think about what I mean, >> And if you think about what I mean, well, we've been thinking a lot about it well, we've been thinking a lot about it well, we've been thinking a lot about it in G&A, but a huge amount of G&A, in G&A, but a huge amount of G&A, in G&A, but a huge amount of G&A, all right, is not invention. all right, is not invention. all right, is not invention. >> No. >> No. >> No. >> Right? And you you may not need >> Right? And you you may not need >> Right? And you you may not need sort of the most sophisticated agents sort of the most sophisticated agents sort of the most sophisticated agents for this. for this. for this. >> And >> And >> And another another another card that's turned over recently is card that's turned over recently is card that's turned over recently is some folks some folks some folks maybe have concerns with the ambition of maybe have concerns with the ambition of maybe have concerns with the ambition of the frontier models and maybe sharing the frontier models and maybe sharing the frontier models and maybe sharing their data data leakage and their data data leakage and their data data leakage and sovereignty of intelligence and they're sovereignty of intelligence and they're sovereignty of intelligence and they're saying, "Hey, saying, "Hey, saying, "Hey, our company is going to choose maybe our company is going to choose maybe our company is going to choose maybe we're in a regulated industry, finance, we're in a regulated industry, finance, we're in a regulated industry, finance, health care, HIPAA, you know, FINRA, all health care, HIPAA, you know, FINRA, all health care, HIPAA, you know, FINRA, all kinds of different regulations. kinds of different regulations. kinds of different regulations. We need to have this on We need to have this on We need to have this on prem prem prem >> Yeah, but on prem >> Yeah, but on prem >> Yeah, but on prem >> domestically and we'd like you know, an >> domestically and we'd like you know, an >> domestically and we'd like you know, an open-source version where we have a open-source version where we have a open-source version where we have a little bit more control. little bit more control. little bit more control. >> Yeah. >> Yeah. >> Yeah. >> And I I think >> And I I think >> And I I think >> Are you seeing that now? >> Are you seeing that now? >> Are you seeing that now? >> seeing that for sure and I I think >> seeing that for sure and I I think >> seeing that for sure and I I think OpenAI made a good call releasing OSS OpenAI made a good call releasing OSS OpenAI made a good call releasing OSS 120B 120B 120B some months back. That was a good some months back. That was a good some months back. That was a good open-source model. open-source model. open-source model. Um, but I think in the US we need more Um, but I think in the US we need more Um, but I think in the US we need more domestic open-source models. We need to domestic open-source models. We need to domestic open-source models. We need to give the world a choice. give the world a choice. give the world a choice. Right? If they want to run open-source Right? If they want to run open-source Right? If they want to run open-source right now, it's OSS 120B or Chinese right now, it's OSS 120B or Chinese right now, it's OSS 120B or Chinese models. models. models. >> Nvidia has some. >> Nvidia has some. >> Nvidia has some. >> Nvidia has seen the same >> Nvidia has seen the same >> Nvidia has seen the same opportunity to push open-source models. opportunity to push open-source models. opportunity to push open-source models. I I I think giving them more power might I I I think giving them more power might I I I think giving them more power might might be sort of might be sort of might be sort of >> Well, I was about to That was you you >> Well, I was about to That was you you >> Well, I was about to That was you you you cut me off at the pass like it you cut me off at the pass like it you cut me off at the pass like it My understanding was Jensen was like, My understanding was Jensen was like, My understanding was Jensen was like, "Hey, we we don't even want to talk "Hey, we we don't even want to talk "Hey, we we don't even want to talk about these open-source models we have about these open-source models we have about these open-source models we have because our customers because our customers because our customers >> Right. >> Right. >> Right. >> we're now going to be competing with >> we're now going to be competing with >> we're now going to be competing with Sam, Dario, Elon, Sam, Dario, Elon, Sam, Dario, Elon, >> uh Sergey. Like, do we want to be in >> uh Sergey. Like, do we want to be in >> uh Sergey. Like, do we want to be in that position? that position? that position? >> Right. >> Right. >> Right. >> So, but we do need some more champions >> So, but we do need some more champions >> So, but we do need some more champions here, and it's open source, so people here, and it's open source, so people here, and it's open source, so people can fork it. Um but that puts you in a can fork it. Um but that puts you in a can fork it. Um but that puts you in a more neutral position. more neutral position. more neutral position. >> That's right. We we we run today we run >> That's right. We we we run today we run >> That's right. We we we run today we run GLM, we run Kimmy, we run the Quincy set GLM, we run Kimmy, we run the Quincy set GLM, we run Kimmy, we run the Quincy set of models, and we run OpenAI's models, of models, and we run OpenAI's models, of models, and we run OpenAI's models, the closed-source ones. We run models the closed-source ones. We run models the closed-source ones. We run models for, say, GlaxoSmithKline, which they for, say, GlaxoSmithKline, which they for, say, GlaxoSmithKline, which they wrote and developed. Um we run models wrote and developed. Um we run models wrote and developed. Um we run models for our partner in the UAE, G42 and for our partner in the UAE, G42 and for our partner in the UAE, G42 and MBZUAI, MBZUAI, MBZUAI, um that are are are their models that um that are are are their models that um that are are are their models that they designed. So, we have a they designed. So, we have a they designed. So, we have a a wide variety. a wide variety. a wide variety. >> So, sovereignty is a trend. >> So, sovereignty is a trend. >> So, sovereignty is a trend. >> Sovereignty is a trend, and I think uh >> Sovereignty is a trend, and I think uh >> Sovereignty is a trend, and I think uh the the the the government's actions with regard to the government's actions with regard to the government's actions with regard to Fable Fable Fable and and and uh 56, uh 56, uh 56, um where they said, "Ho, whoa. Let's um where they said, "Ho, whoa. Let's um where they said, "Ho, whoa. Let's think. think. think. And then we can act." And then we can act." And then we can act." Um I I think sort of Um I I think sort of Um I I think sort of particularly here in Europe was a bit of particularly here in Europe was a bit of particularly here in Europe was a bit of a wake-up call. a wake-up call. a wake-up call. >> And when you saw this going down, >> And when you saw this going down, >> And when you saw this going down, there's a layer of partisanship in our there's a layer of partisanship in our there's a layer of partisanship in our country right now. It's pretty fervent. country right now. It's pretty fervent. country right now. It's pretty fervent. Dario is pretty explicitly, you know, Dario is pretty explicitly, you know, Dario is pretty explicitly, you know, not part of this administration. not part of this administration. not part of this administration. >> They've been very adversarial. Both >> They've been very adversarial. Both >> They've been very adversarial. Both sides have been have admitted that. sides have been have admitted that. sides have been have admitted that. They're starting to work it out now. So, They're starting to work it out now. So, They're starting to work it out now. So, it's hard, I think, for us, not being in it's hard, I think, for us, not being in it's hard, I think, for us, not being in the room with these parties, to the room with these parties, to the room with these parties, to understand what's partisanship, what's understand what's partisanship, what's understand what's partisanship, what's gamesmanship here. gamesmanship here. gamesmanship here. >> But do you believe that what they >> But do you believe that what they >> But do you believe that what they released released released was truly dangerous for cyber warfare, was truly dangerous for cyber warfare, was truly dangerous for cyber warfare, for cyber attacks, for cyber attacks, for cyber attacks, and that if you were to rate Dario's and that if you were to rate Dario's and that if you were to rate Dario's not communication, because he's a very not communication, because he's a very not communication, because he's a very effervescent communicator. effervescent communicator. effervescent communicator. Um, I think it's a diplomatic way to say Um, I think it's a diplomatic way to say Um, I think it's a diplomatic way to say it. it. it. Um, Um, Um, but but but to have a scheduled rolled out release. to have a scheduled rolled out release. to have a scheduled rolled out release. Right. We'll put aside the government's Right. We'll put aside the government's Right. We'll put aside the government's control of it. control of it. control of it. But, do you think that is is a wise But, do you think that is is a wise But, do you think that is is a wise thing for us to do at this point? And do thing for us to do at this point? And do thing for us to do at this point? And do you think it's there was actually a you think it's there was actually a you think it's there was actually a major threat there? major threat there? major threat there? >> So, what's interesting is I hadn't seen >> So, what's interesting is I hadn't seen >> So, what's interesting is I hadn't seen it before. it before. it before. >> Mhm. >> Mhm. >> Mhm. >> Right. And I I think, you know, if we >> Right. And I I think, you know, if we >> Right. And I I think, you know, if we just step back and say, just step back and say, just step back and say, "Is it reasonable? "Is it reasonable? "Is it reasonable? I don't know I don't know I don't know whe- whether this was the right time, whe- whether this was the right time, whe- whether this was the right time, but at a time but at a time but at a time >> Mhm. >> Mhm. >> Mhm. >> th- that that a model is sufficiently >> th- that that a model is sufficiently >> th- that that a model is sufficiently uh, creative in its thinking uh, creative in its thinking uh, creative in its thinking that it poses a meaningful threat for that it poses a meaningful threat for that it poses a meaningful threat for the government to say, 'We like you to the government to say, 'We like you to the government to say, 'We like you to roll it out in steps.'" roll it out in steps.'" roll it out in steps.'" >> Yeah. >> Yeah. >> Yeah. >> Now, this doesn't seem unreasonable to >> Now, this doesn't seem unreasonable to >> Now, this doesn't seem unreasonable to me. me. me. >> Not at all. >> Not at all. >> Not at all. >> Right? I mean, we we do this with >> Right? I mean, we we do this with >> Right? I mean, we we do this with powerful pharmaceuticals. powerful pharmaceuticals. powerful pharmaceuticals. Right? We We We like I mean, Right? We We We like I mean, Right? We We We like I mean, we're certainly not encouraging 7 years we're certainly not encouraging 7 years we're certainly not encouraging 7 years of trial and the amount of paperwork and of trial and the amount of paperwork and of trial and the amount of paperwork and all the garbage that has accrued to the all the garbage that has accrued to the all the garbage that has accrued to the FDA. FDA. FDA. But, with a powerful new technology, it But, with a powerful new technology, it But, with a powerful new technology, it certainly doesn't seem unreasonable to certainly doesn't seem unreasonable to certainly doesn't seem unreasonable to say, "Hey guys, um, let's at least do say, "Hey guys, um, let's at least do say, "Hey guys, um, let's at least do some red teaming at the government so we some red teaming at the government so we some red teaming at the government so we know our defenses can block this." know our defenses can block this." know our defenses can block this." >> Yeah, have we checked Have we checked >> Yeah, have we checked Have we checked >> Yeah, have we checked Have we checked the infrastructure of the country like the infrastructure of the country like the infrastructure of the country like >> NSA? Have we checked the infrastructure >> NSA? Have we checked the infrastructure >> NSA? Have we checked the infrastructure of Right? [clears throat] And can you of Right? [clears throat] And can you of Right? [clears throat] And can you give us 2 or 3 weeks to patch any give us 2 or 3 weeks to patch any give us 2 or 3 weeks to patch any obvious holes that are found? obvious holes that are found? obvious holes that are found? >> Right. This doesn't seem to me >> Right. This doesn't seem to me >> Right. This doesn't seem to me >> an unreasonable thing for the government >> an unreasonable thing for the government >> an unreasonable thing for the government to ask. to ask. to ask. >> Right. We but we in this very polarized >> Right. We but we in this very polarized >> Right. We but we in this very polarized time time time >> Yeah. >> Yeah. >> Yeah. >> put on top of it, well, oh my god, it's >> put on top of it, well, oh my god, it's >> put on top of it, well, oh my god, it's President Trump doing it, and then you President Trump doing it, and then you President Trump doing it, and then you have to think, well, what if it was have to think, well, what if it was have to think, well, what if it was President OAC AOC or President anybody President OAC AOC or President anybody President OAC AOC or President anybody in between the the two extremes. in between the the two extremes. in between the the two extremes. >> I think the polarization hurts a great >> I think the polarization hurts a great >> I think the polarization hurts a great deal. It hurts clear thinking. deal. It hurts clear thinking. deal. It hurts clear thinking. >> It does. >> It does. >> It does. >> It It It hurts clear thinking, and and >> It It It hurts clear thinking, and and >> It It It hurts clear thinking, and and and both sides are going to do some dumb and both sides are going to do some dumb and both sides are going to do some dumb things and some really smart things. things and some really smart things. things and some really smart things. >> Right. >> Right. >> Right. >> Right. And And in fact, what I found is >> Right. And And in fact, what I found is >> Right. And And in fact, what I found is that the people in the government are that the people in the government are that the people in the government are are trying really hard. Uh are trying really hard. Uh are trying really hard. Uh >> The rank and file. >> The rank and file. >> The rank and file. >> and file are trying really hard. And >> and file are trying really hard. And >> and file are trying really hard. And this is moving fast. And I I think that this is moving fast. And I I think that this is moving fast. And I I think that that that that our ability to to set aside some some of our ability to to set aside some some of our ability to to set aside some some of the the polarization and say, the the polarization and say, the the polarization and say, "How do we do this in a reasonable "How do we do this in a reasonable "How do we do this in a reasonable manner?" I mean, we we want Dario and manner?" I mean, we we want Dario and manner?" I mean, we we want Dario and Sam competing like crazy. Sam competing like crazy. Sam competing like crazy. >> 100% It's been awesome to watch. >> 100% It's been awesome to watch. >> 100% It's been awesome to watch. >> Yeah. >> Yeah. >> Yeah. >> Right. It's good for the technology. >> Right. It's good for the technology. >> Right. It's good for the technology. It's good for It's good for It's good for It's good for It's good for It's good for entrepreneurs to see even with thousands entrepreneurs to see even with thousands entrepreneurs to see even with thousands of people that this is what what you can of people that this is what what you can of people that this is what what you can continue to achieve. continue to achieve. continue to achieve. >> Right. >> Right. >> Right. >> Right. This is a drive. >> Right. This is a drive. >> Right. This is a drive. >> in the ass, make them get sharper, >> in the ass, make them get sharper, >> in the ass, make them get sharper, Amazon do a better job at that. Amazon do a better job at that. Amazon do a better job at that. >> Everybody got better because of that. We >> Everybody got better because of that. We >> Everybody got better because of that. We want that. And we certainly don't want want that. And we certainly don't want want that. And we certainly don't want to become sort of a region where the to become sort of a region where the to become sort of a region where the first thing we want is regulated. first thing we want is regulated. first thing we want is regulated. >> Right. >> Right. >> Right. >> Right. But as it gets more powerful, >> Right. But as it gets more powerful, >> Right. But as it gets more powerful, >> And the industry really should do a >> And the industry really should do a >> And the industry really should do a better job of regulating itself, better job of regulating itself, better job of regulating itself, perhaps. And and it did seem perhaps. And and it did seem perhaps. And and it did seem like they were starting that like they were starting that like they were starting that process, but then the communication was process, but then the communication was process, but then the communication was lacking, maybe. lacking, maybe. lacking, maybe. >> uh >> uh >> uh You know, I I think not only are they You know, I I think not only are they You know, I I think not only are they racing hard, but they're inventing this racing hard, but they're inventing this racing hard, but they're inventing this as they go, too. as they go, too. as they go, too. >> Yeah. Right. There's not a playbook. No. >> Yeah. Right. There's not a playbook. No. >> Yeah. Right. There's not a playbook. No. >> Right. They're inventing that we we say, >> Right. They're inventing that we we say, >> Right. They're inventing that we we say, "Oh, just put on guardrails." Well, they "Oh, just put on guardrails." Well, they "Oh, just put on guardrails." Well, they have to design the guardrails. have to design the guardrails. have to design the guardrails. >> Sure. >> Sure. >> Sure. >> Right. They the guardrails have an >> Right. They the guardrails have an >> Right. They the guardrails have an impact. Um you know, one of the things impact. Um you know, one of the things impact. Um you know, one of the things that Fast does is it makes the that Fast does is it makes the that Fast does is it makes the guardrails less painful. And so that guardrails less painful. And so that guardrails less painful. And so that that is we we that is we we that is we we we discovered that in the last 6 weeks. we discovered that in the last 6 weeks. we discovered that in the last 6 weeks. >> Yeah. >> Yeah. >> Yeah. >> It is that the very guardrails can add >> It is that the very guardrails can add >> It is that the very guardrails can add time and make it feel slower, and so time and make it feel slower, and so time and make it feel slower, and so Fast chips like ours it can really help Fast chips like ours it can really help Fast chips like ours it can really help that. But so they're that. But so they're that. But so they're >> Right. >> Right. >> Right. >> against competition. They're racing >> against competition. They're racing >> against competition. They're racing against their own sense of greatness. against their own sense of greatness. against their own sense of greatness. >> Yeah. >> Yeah. >> Yeah. >> Right. Which is maybe even the biggest >> Right. Which is maybe even the biggest >> Right. Which is maybe even the biggest driver here. driver here. driver here. And I think that they're earnest trying And I think that they're earnest trying And I think that they're earnest trying to think about how to do the right to think about how to do the right to think about how to do the right thing. And, all of those are are are thing. And, all of those are are are thing. And, all of those are are are mixed in this bucket. And, and sometimes mixed in this bucket. And, and sometimes mixed in this bucket. And, and sometimes you're on one side rather than the you're on one side rather than the you're on one side rather than the other. other. other. >> Yeah, and as you're saying, this is a >> Yeah, and as you're saying, this is a >> Yeah, and as you're saying, this is a first time, right? first time, right? first time, right? >> That's right. >> That's right. >> That's right. >> When we with 3.5 came out, it wasn't >> When we with 3.5 came out, it wasn't >> When we with 3.5 came out, it wasn't like when we were using ChatGPT 2.5, like when we were using ChatGPT 2.5, like when we were using ChatGPT 2.5, 3.5, it was taking down networks. 3.5, it was taking down networks. 3.5, it was taking down networks. >> Right. >> Right. >> Right. >> But, in talking to Nikesh >> But, in talking to Nikesh >> But, in talking to Nikesh from Palo Alto Networks, I asked him from Palo Alto Networks, I asked him from Palo Alto Networks, I asked him like, "Hey, like, "Hey, like, "Hey, how would you grade this?" And he said, how would you grade this?" And he said, how would you grade this?" And he said, "We put it against our software, and we "We put it against our software, and we "We put it against our software, and we found bugs we were not aware of." found bugs we were not aware of." found bugs we were not aware of." >> Yes, it killed them. >> Yes, it killed them. >> Yes, it killed them. >> Yeah, he said, "We had to stop >> Yeah, he said, "We had to stop >> Yeah, he said, "We had to stop everything we're doing and do patches everything we're doing and do patches everything we're doing and do patches for 6 weeks." for 6 weeks." for 6 weeks." >> Right. And and that's when you know, >> Right. And and that's when you know, >> Right. And and that's when you know, right? I mean, right? I mean, right? I mean, Nikesh leads a you know, maybe the Nikesh leads a you know, maybe the Nikesh leads a you know, maybe the leading security software firm, right? leading security software firm, right? leading security software firm, right? And when it finds in an hour, And when it finds in an hour, And when it finds in an hour, >> [laughter] >> [laughter] >> [laughter] >> right, tens of critical opens, you're >> right, tens of critical opens, you're >> right, tens of critical opens, you're like, "Whoa, this is a powerful tool." like, "Whoa, this is a powerful tool." like, "Whoa, this is a powerful tool." >> Yeah, I mean, >> Yeah, I mean, >> Yeah, I mean, >> And we need to think. And and maybe you >> And we need to think. And and maybe you >> And we need to think. And and maybe you you show it to you show it to you show it to a group first, a group first, a group first, right? May- maybe you I don't know what right? May- maybe you I don't know what right? May- maybe you I don't know what the right thing is, but the right thing is, but the right thing is, but >> red teaming and uh we've always had >> red teaming and uh we've always had >> red teaming and uh we've always had just when you were releasing the new just when you were releasing the new just when you were releasing the new version of version of version of um an operating system, you know, when um an operating system, you know, when um an operating system, you know, when you have your iPhone, you can say, "I you have your iPhone, you can say, "I you have your iPhone, you can say, "I want to be part of the beta." want to be part of the beta." want to be part of the beta." >> That's right. >> That's right. >> That's right. >> You know. >> You know. >> You know. >> Right. And there's like two other betas >> Right. And there's like two other betas >> Right. And there's like two other betas that you don't even get the chance to that you don't even get the chance to that you don't even get the chance to opt into as consumers. opt into as consumers. opt into as consumers. >> Right. >> Right. >> Right. >> Those ones are for security. Those ones >> Those ones are for security. Those ones >> Those ones are for security. Those ones are for, you know, making sure you don't are for, you know, making sure you don't are for, you know, making sure you don't lose your data or data that's deleted. lose your data or data that's deleted. lose your data or data that's deleted. >> That's right. Disappear or leak or >> That's right. Disappear or leak or >> That's right. Disappear or leak or >> corruption. >> corruption. >> corruption. >> Right. >> Right. >> Right. >> Any any number of uh these things. >> Any any number of uh these things. >> Any any number of uh these things. >> I think we can also know >> I think we can also know >> I think we can also know that that there will be a massive data that that there will be a massive data that that there will be a massive data leak. leak. leak. >> Of course. >> Of course. >> Of course. >> We we we know this, right? And it's like >> We we we know this, right? And it's like >> We we we know this, right? And it's like uh Warren Buffett talked about the uh Warren Buffett talked about the uh Warren Buffett talked about the reinsurance industry that you know reinsurance industry that you know reinsurance industry that you know something bad's going to happen. You something bad's going to happen. You something bad's going to happen. You don't know when, don't know when, don't know when, >> Yeah. >> Yeah. >> Yeah. >> but you got to save up for it. Right. >> but you got to save up for it. Right. >> but you got to save up for it. Right. You you money away for for insurance. You you money away for for insurance. You you money away for for insurance. >> But >> But >> But >> there will be a tornado. There will be a >> there will be a tornado. There will be a >> there will be a tornado. There will be a massive earthquake. I mean, we we know massive earthquake. I mean, we we know massive earthquake. I mean, we we know this. this. this. And we can do our best to plan. And we can do our best to plan. And we can do our best to plan. But there'll be a massive breach. And But there'll be a massive breach. And But there'll be a massive breach. And they'll they'll be and we have to steel they'll they'll be and we have to steel they'll they'll be and we have to steel ourselves in advance. And we have to ourselves in advance. And we have to ourselves in advance. And we have to think about it and think about the right think about it and think about the right think about it and think about the right response at the time. And so to prepare response at the time. And so to prepare response at the time. And so to prepare ourselves for a future that is in ourselves for a future that is in ourselves for a future that is in specific unknown, but in general we're specific unknown, but in general we're specific unknown, but in general we're pretty sure it's going to something's pretty sure it's going to something's pretty sure it's going to something's going to happen. going to happen. going to happen. >> Something >> Something >> Something >> [snorts] >> [snorts] >> [snorts] >> will happen. Uh and >> will happen. Uh and >> will happen. Uh and yeah, it's typically a black swan, yeah, it's typically a black swan, yeah, it's typically a black swan, right? I mean, by definition it's going right? I mean, by definition it's going right? I mean, by definition it's going to be something we didn't consider or a to be something we didn't consider or a to be something we didn't consider or a question we didn't know to ask. question we didn't know to ask. question we didn't know to ask. >> Right. But but even knowing that there's >> Right. But but even knowing that there's >> Right. But but even knowing that there's some unknown unknowns is a useful place some unknown unknowns is a useful place some unknown unknowns is a useful place to start. to start. to start. >> Yeah. What are we not asking ourselves? >> Yeah. What are we not asking ourselves? >> Yeah. What are we not asking ourselves? >> That's right. >> That's right. >> That's right. >> With reasoning, the AI is going to be >> With reasoning, the AI is going to be >> With reasoning, the AI is going to be able to tell us, "Hey, schmuck humans. able to tell us, "Hey, schmuck humans. able to tell us, "Hey, schmuck humans. >> That's right. >> That's right. >> That's right. >> By the way, here's what you're not >> By the way, here's what you're not >> By the way, here's what you're not thinking about. This is now my closing thinking about. This is now my closing thinking about. This is now my closing sentence when I do my prompting is I sentence when I do my prompting is I sentence when I do my prompting is I need you to make me a prompt need you to make me a prompt need you to make me a prompt that will help me do this trend scouting that will help me do this trend scouting that will help me do this trend scouting for an example." And then I always say for an example." And then I always say for an example." And then I always say at the end, um "Please uh check your at the end, um "Please uh check your at the end, um "Please uh check your work. work. work. >> Right. >> Right. >> Right. >> Uh and >> Uh and >> Uh and uh then tell me what I haven't uh then tell me what I haven't uh then tell me what I haven't considered in terms of my goals. And considered in terms of my goals. And considered in terms of my goals. And give me ask me some questions every time give me ask me some questions every time give me ask me some questions every time you run the job." And that has changed you run the job." And that has changed you run the job." And that has changed everything because it's like I checked everything because it's like I checked everything because it's like I checked my work. By the way, this was incorrect. my work. By the way, this was incorrect. my work. By the way, this was incorrect. >> Right. >> Right. >> Right. >> And I'm wondering, "Hey, would you like >> And I'm wondering, "Hey, would you like >> And I'm wondering, "Hey, would you like me to also do this?" And some of the me to also do this?" And some of the me to also do this?" And some of the tools like Perplexity do that tools like Perplexity do that tools like Perplexity do that automatically to give you your next automatically to give you your next automatically to give you your next three prompts. three prompts. three prompts. >> Right. >> Right. >> Right. >> But if you give it explicit >> But if you give it explicit >> But if you give it explicit instructions, my lord is it good at instructions, my lord is it good at instructions, my lord is it good at that. So, you know, that. So, you know, that. So, you know, >> over the course of the last 10 years as >> over the course of the last 10 years as >> over the course of the last 10 years as I was raising money, I I thought one of I was raising money, I I thought one of I was raising money, I I thought one of the smarter questions I got at the end the smarter questions I got at the end the smarter questions I got at the end of a conversation where someone asked, of a conversation where someone asked, of a conversation where someone asked, "What what was the smartest question you "What what was the smartest question you "What what was the smartest question you heard that that wasn't covered by what I heard that that wasn't covered by what I heard that that wasn't covered by what I asked?" asked?" asked?" >> Incredible. >> Incredible. >> Incredible. >> Right. Now now that's somebody who's >> Right. Now now that's somebody who's >> Right. Now now that's somebody who's curious and thinking and humble and and curious and thinking and humble and and curious and thinking and humble and and trying to sort of use this to get a trying to sort of use this to get a trying to sort of use this to get a picture picture picture of of of >> of the space. And to the extent that you >> of the space. And to the extent that you >> of the space. And to the extent that you can ask the AI that and that it can sort can ask the AI that and that it can sort can ask the AI that and that it can sort of broaden your your view. You know, of broaden your your view. You know, of broaden your your view. You know, maybe what questions should I have maybe what questions should I have maybe what questions should I have asked? asked? asked? >> Yeah. >> Yeah. >> Yeah. >> To be an expert in this. What what what >> To be an expert in this. What what what >> To be an expert in this. What what what would a PhD level uh would a PhD level uh would a PhD level uh questioner ask? questioner ask? questioner ask? >> Right. >> Right. >> Right. >> Or a gold medal math. I mean, I I think >> Or a gold medal math. I mean, I I think >> Or a gold medal math. I mean, I I think those are sort of those are sort of those are sort of questions that you know you don't even questions that you know you don't even questions that you know you don't even know how to ask. Which know how to ask. Which know how to ask. Which >> You know, if we start thinking about AGI >> You know, if we start thinking about AGI >> You know, if we start thinking about AGI and superintelligence and superintelligence and superintelligence um you know, they're just definitions, um you know, they're just definitions, um you know, they're just definitions, but but but they're important definitions I think to they're important definitions I think to they're important definitions I think to kind of keep in mind because they're kind of keep in mind because they're kind of keep in mind because they're waypoints. waypoints. waypoints. >> That's right. And AGI >> That's right. And AGI >> That's right. And AGI I think I think I think I suspect you'll agree with me that I suspect you'll agree with me that I suspect you'll agree with me that we've hit it. We just haven't exactly we've hit it. We just haven't exactly we've hit it. We just haven't exactly deployed it deployed it deployed it fully. We we we have artificial general fully. We we we have artificial general fully. We we we have artificial general intelligence now. It feels like when intelligence now. It feels like when intelligence now. It feels like when we're talking about these reasoning we're talking about these reasoning we're talking about these reasoning moments and you know, the the moments and you know, the the moments and you know, the the the ability for it to be as smart as any the ability for it to be as smart as any the ability for it to be as smart as any human, but human, but human, but Let's talk about Let's talk about Let's talk about >> By any definition we had 20 years ago >> By any definition we had 20 years ago >> By any definition we had 20 years ago we've hit it. we've hit it. we've hit it. >> Yes. >> Yes. >> Yes. >> Right. I mean, if you think about it, >> Right. I mean, if you think about it, >> Right. I mean, if you think about it, all those Turing tests blew it away. I all those Turing tests blew it away. I all those Turing tests blew it away. I mean, you think about that that any mean, you think about that that any mean, you think about that that any period of time period of time period of time sort of 10, 15, 20, 30, 40, 50 years ago sort of 10, 15, 20, 30, 40, 50 years ago sort of 10, 15, 20, 30, 40, 50 years ago we we we any definition we would have we we we any definition we would have we we we any definition we would have previously put forward previously put forward previously put forward >> Right. >> Right. >> Right. >> we've blown past it. And so >> we've blown past it. And so >> we've blown past it. And so >> Which goes back to our previous point of >> Which goes back to our previous point of >> Which goes back to our previous point of like do we know the questions to ask? like do we know the questions to ask? like do we know the questions to ask? >> That's right. >> That's right. >> That's right. >> 20 years ago science fiction authors >> 20 years ago science fiction authors >> 20 years ago science fiction authors you know, you know, you know, had their say and we answered all their had their say and we answered all their had their say and we answered all their questions. questions. questions. If they were to look at this today, If they were to look at this today, If they were to look at this today, they'd be like, well, I'm out of they'd be like, well, I'm out of they'd be like, well, I'm out of I'm out of questions. Sorry. I'm out of questions. Sorry. I'm out of questions. Sorry. >> That's where sort of the >> That's where sort of the >> That's where sort of the sort of listening to people who we who sort of listening to people who we who sort of listening to people who we who sound sometimes like they're on the sound sometimes like they're on the sound sometimes like they're on the fringe. fringe. fringe. >> Yeah. >> Yeah. >> Yeah. >> When when when Ilya was talking eight or >> When when when Ilya was talking eight or >> When when when Ilya was talking eight or 10 years ago about the need for safety 10 years ago about the need for safety 10 years ago about the need for safety and then and you're like, what? and then and you're like, what? and then and you're like, what? Dead right. Dead right. Dead right. >> Yeah. >> Yeah. >> Yeah. >> Right, when when when Elon was talking >> Right, when when when Elon was talking >> Right, when when when Elon was talking about building rockets and driving the about building rockets and driving the about building rockets and driving the cost to to to near zero of of of a cost to to to near zero of of of a cost to to to near zero of of of a launch vehicle, you're like, what? And launch vehicle, you're like, what? And launch vehicle, you're like, what? And there it is. And and now you can see it. there it is. And and now you can see it. there it is. And and now you can see it. And that's And that's And that's I think that's why it's really fun to be I think that's why it's really fun to be I think that's why it's really fun to be a technologist now. a technologist now. a technologist now. >> [snorts] >> [snorts] >> [snorts] >> Well, and with these tools specifically, >> Well, and with these tools specifically, >> Well, and with these tools specifically, you know, we're talking about building you know, we're talking about building you know, we're talking about building all of these tools, and then the tools all of these tools, and then the tools all of these tools, and then the tools are starting to build themselves in this are starting to build themselves in this are starting to build themselves in this recursive loop. recursive loop. recursive loop. >> That's right. >> That's right. >> That's right. >> And we're >> And we're >> And we're kind of just starting to see people kind of just starting to see people kind of just starting to see people apply loops. Uh in fact, loop maxing apply loops. Uh in fact, loop maxing apply loops. Uh in fact, loop maxing became when I was doing my trend became when I was doing my trend became when I was doing my trend when I did my trending, it kept picking when I did my trending, it kept picking when I did my trending, it kept picking up loop looping, and it kept picking up up loop looping, and it kept picking up up loop looping, and it kept picking up the maxing stuff, and it created a the maxing stuff, and it created a the maxing stuff, and it created a buzzword for me, loop maxing. buzzword for me, loop maxing. buzzword for me, loop maxing. >> Right. >> Right. >> Right. >> And then it magically people started >> And then it magically people started >> And then it magically people started talking about loop maxing, and I was talking about loop maxing, and I was talking about loop maxing, and I was like, wow, this is really weird. It like, wow, this is really weird. It like, wow, this is really weird. It anticipated that this would other humans anticipated that this would other humans anticipated that this would other humans would come up with this word. But talk a would come up with this word. But talk a would come up with this word. But talk a little bit about recursive, and then the little bit about recursive, and then the little bit about recursive, and then the road to super intelligence. And do you road to super intelligence. And do you road to super intelligence. And do you have a way, Andrew, that you think about have a way, Andrew, that you think about have a way, Andrew, that you think about super intelligence, and what super intelligence, and what super intelligence, and what >> [snorts] >> [snorts] >> [snorts] >> it will mean for humanity, and how we >> it will mean for humanity, and how we >> it will mean for humanity, and how we will define it, and how we'll experience will define it, and how we'll experience will define it, and how we'll experience it. Yeah. it. Yeah. it. Yeah. >> I I I think let's begin on on on loop >> I I I think let's begin on on on loop >> I I I think let's begin on on on loop maxing, or sort of recursive learning. I maxing, or sort of recursive learning. I maxing, or sort of recursive learning. I I I think um I think what what what Sam Ennillia, and I think what what what Sam Ennillia, and then later Dario, and and and then later Dario, and and and then later Dario, and and and Dennis saw Dennis saw Dennis saw um um um 6 years ago, or 5 years ago, was that um 6 years ago, or 5 years ago, was that um 6 years ago, or 5 years ago, was that um powerful recursive games powerful recursive games powerful recursive games are exponential. are exponential. are exponential. >> Mhm. >> Mhm. >> Mhm. >> Right? You get better, you do it again, >> Right? You get better, you do it again, >> Right? You get better, you do it again, and if you continue to get gain, and if you continue to get gain, and if you continue to get gain, the the the the slope of that curve is the the the the slope of that curve is the the the the slope of that curve is so steep. so steep. so steep. >> Yeah. >> Yeah. >> Yeah. >> And that um we're just beginning to see >> And that um we're just beginning to see >> And that um we're just beginning to see that now. that now. that now. >> You ask it a question, you learn from >> You ask it a question, you learn from >> You ask it a question, you learn from the results, you ask it to do it again. the results, you ask it to do it again. the results, you ask it to do it again. Uh-huh. It the results get better and Uh-huh. It the results get better and Uh-huh. It the results get better and more information is added. Your answer more information is added. Your answer more information is added. Your answer gets better. You ask it to do again, it gets better. You ask it to do again, it gets better. You ask it to do again, it covers more material. And these sort of covers more material. And these sort of covers more material. And these sort of loops are producing sort of not a little loops are producing sort of not a little loops are producing sort of not a little bit better answers, but vastly better bit better answers, but vastly better bit better answers, but vastly better answers. answers. answers. >> Yeah. >> Yeah. >> Yeah. >> And that is a >> And that is a >> And that is a enormously powerful because we don't enormously powerful because we don't enormously powerful because we don't quite know where it ends. quite know where it ends. quite know where it ends. >> Right. >> Right. >> Right. >> keep throwing compute at it. I mean, how >> keep throwing compute at it. I mean, how >> keep throwing compute at it. I mean, how much better does the answer get? You much better does the answer get? You much better does the answer get? You know, we we run out of tokens or our know, we we run out of tokens or our know, we we run out of tokens or our budget or or or but but holy cow. I budget or or or but but holy cow. I budget or or or but but holy cow. I mean, when does the exponential stop? Or mean, when does the exponential stop? Or mean, when does the exponential stop? Or does the answer keep going up and up and does the answer keep going up and up and does the answer keep going up and up and up to the right? up to the right? up to the right? >> Yeah. >> Yeah. >> Yeah. >> And that's sort of an enormously >> And that's sort of an enormously >> And that's sort of an enormously interesting intellectual question right interesting intellectual question right interesting intellectual question right now. now. now. Uh-huh. Uh-huh. Uh-huh. >> Yeah, like when do we run out of >> Yeah, like when do we run out of >> Yeah, like when do we run out of problems to solve and problems to solve and problems to solve and >> Well, that's right. And and when are are >> Well, that's right. And and when are are >> Well, that's right. And and when are are the the problems the the problems the the problems no longer sort of intellectual problems no longer sort of intellectual problems no longer sort of intellectual problems and that you're now people problems. and that you're now people problems. and that you're now people problems. >> Yeah. >> Yeah. >> Yeah. >> Right. How to organize people to to get >> Right. How to organize people to to get >> Right. How to organize people to to get done with the AI asked for. done with the AI asked for. done with the AI asked for. Right. I mean, as you know in running Right. I mean, as you know in running Right. I mean, as you know in running your company, your company, your company, a lot of your problems aren't hard a lot of your problems aren't hard a lot of your problems aren't hard intellectual problems. They're people intellectual problems. They're people intellectual problems. They're people working together problems. working together problems. working together problems. >> Yeah. >> Yeah. >> Yeah. >> Right. >> Right. >> Right. >> And you motivation >> And you motivation >> And you motivation >> Motivation. You spend a lot of time as a >> Motivation. You spend a lot of time as a >> Motivation. You spend a lot of time as a leader spraying WD-40 on your team. leader spraying WD-40 on your team. leader spraying WD-40 on your team. >> Right. >> Right. >> Right. >> Right. It just so so so friction is >> Right. It just so so so friction is >> Right. It just so so so friction is reduced and reduced and reduced and um um um how do we learn about those from AI? how do we learn about those from AI? how do we learn about those from AI? Right. How do we get behavioral Right. How do we get behavioral Right. How do we get behavioral insights? From from AI and and I think insights? From from AI and and I think insights? From from AI and and I think that's some of the things the world that's some of the things the world that's some of the things the world models are going to bring us as they models are going to bring us as they models are going to bring us as they begin to watch human behavior. begin to watch human behavior. begin to watch human behavior. >> Yeah, we didn't even get to that. This >> Yeah, we didn't even get to that. This >> Yeah, we didn't even get to that. This is going to be for another interview, is going to be for another interview, is going to be for another interview, but but but um when these things jump off the um when these things jump off the um when these things jump off the screens screens screens >> Right. >> Right. >> Right. >> and they're in the real world and the >> and they're in the real world and the >> and they're in the real world and the recursiveness starts recursiveness starts recursiveness starts not trying to solve math problems and not trying to solve math problems and not trying to solve math problems and >> Right. >> Right. >> Right. >> humanities' most difficult ones, but >> humanities' most difficult ones, but >> humanities' most difficult ones, but hey, you know, there's an incredible hey, you know, there's an incredible hey, you know, there's an incredible world out here and here's the Palace of world out here and here's the Palace of world out here and here's the Palace of Versailles. Right. You're just like now Versailles. Right. You're just like now Versailles. Right. You're just like now we're like, make me a new version of we're like, make me a new version of we're like, make me a new version of Salesforce and we're like, hey, you know Salesforce and we're like, hey, you know Salesforce and we're like, hey, you know what? I'd like a Palace of Versailles. what? I'd like a Palace of Versailles. what? I'd like a Palace of Versailles. I've got 100 acres somewhere out in I've got 100 acres somewhere out in I've got 100 acres somewhere out in right Texas or Nevada. I'll just send a right Texas or Nevada. I'll just send a right Texas or Nevada. I'll just send a thousand optimists out there. Make me thousand optimists out there. Make me thousand optimists out there. Make me the Palace of Versailles. the Palace of Versailles. the Palace of Versailles. >> Right. >> Right. >> Right. >> Sounds fantastical, but the Palace of >> Sounds fantastical, but the Palace of >> Sounds fantastical, but the Palace of Versailles would seem fantastical to Versailles would seem fantastical to Versailles would seem fantastical to people who lived a thousand years before people who lived a thousand years before people who lived a thousand years before it. it. it. >> And it was fantastical, I think, to the >> And it was fantastical, I think, to the >> And it was fantastical, I think, to the people who built it. people who built it. people who built it. Right, even to the builders. I I think Right, even to the builders. I I think Right, even to the builders. I I think they were awed they were awed they were awed >> Yeah. >> Yeah. >> Yeah. >> at it as they built it. >> at it as they built it. >> at it as they built it. >> Yeah, they're compounding they're >> Yeah, they're compounding they're >> Yeah, they're compounding they're compounding recursive learning compounding recursive learning compounding recursive learning >> That's right. >> That's right. >> That's right. >> and generations we talked about. You had >> and generations we talked about. You had >> and generations we talked about. You had a really such a great insight of a really such a great insight of a really such a great insight of in building this place you had in building this place you had in building this place you had generations of Masons. generations of Masons. generations of Masons. >> Yeah. I I think in in in all these large >> Yeah. I I think in in in all these large >> Yeah. I I think in in in all these large projects, projects, projects, um, often there were families uh, who um, often there were families uh, who um, often there were families uh, who were specialists who and uh, you you were specialists who and uh, you you were specialists who and uh, you you apprenticed under your father, your apprenticed under your father, your apprenticed under your father, your uncle. And when you had a project that uncle. And when you had a project that uncle. And when you had a project that took the 50 or 70 or 100 years, you took the 50 or 70 or 100 years, you took the 50 or 70 or 100 years, you might have three or four generations of might have three or four generations of might have three or four generations of the same family the same family the same family right, the same stone mason family right, the same stone mason family right, the same stone mason family working on the same structure. working on the same structure. working on the same structure. >> And passing on the learning. >> And passing on the learning. >> And passing on the learning. >> on the learnings. >> on the learnings. >> on the learnings. >> New innovations. >> New innovations. >> New innovations. >> Right. >> Right. >> Right. >> Which is what we've modeled >> Which is what we've modeled >> Which is what we've modeled with this new with this new with this new >> That's right. >> That's right. >> That's right. >> models >> models >> models and what you're building in the and what you're building in the and what you're building in the infrastructure. infrastructure. infrastructure. It's pretty incredible when you think It's pretty incredible when you think It's pretty incredible when you think about it. about it. about it. >> when we're sitting here in >> when we're sitting here in >> when we're sitting here in >> But the Versailles, the And that's what >> But the Versailles, the And that's what >> But the Versailles, the And that's what I mean, I I think the the problem with I mean, I I think the the problem with I mean, I I think the the problem with human learning human learning human learning is um, is um, is um, it often moves at at the pace of a it often moves at at the pace of a it often moves at at the pace of a generation. generation. generation. >> Huh. >> Huh. >> Huh. >> And like >> And like >> And like uh, elephants and other large mammals, uh, elephants and other large mammals, uh, elephants and other large mammals, we don't have generations but every 15 we don't have generations but every 15 we don't have generations but every 15 or 20 years. And if you want to move or 20 years. And if you want to move or 20 years. And if you want to move really quickly across generations, really quickly across generations, really quickly across generations, you want them happening more like you want them happening more like you want them happening more like Drosophila, like food fly. You want two Drosophila, like food fly. You want two Drosophila, like food fly. You want two a day. a day. a day. >> Yeah. >> Yeah. >> Yeah. >> Right. Then and you see that in >> Right. Then and you see that in >> Right. Then and you see that in genetics. that's why we study them in genetics. that's why we study them in genetics. that's why we study them in genetics cuz learning encoded in the genetics cuz learning encoded in the genetics cuz learning encoded in the DNA, you can study over thousands of DNA, you can study over thousands of DNA, you can study over thousands of generations. generations. generations. And I I think that what we're getting is And I I think that what we're getting is And I I think that what we're getting is that equivalent in AI, we're getting that equivalent in AI, we're getting that equivalent in AI, we're getting sort of learning so quickly sort of learning so quickly sort of learning so quickly over the equivalent of thousands of over the equivalent of thousands of over the equivalent of thousands of generations. generations. generations. >> would be >> would be >> would be in awe of this in awe of this in awe of this uh pace of evolution. uh pace of evolution. uh pace of evolution. >> That's exactly right. You think about it >> That's exactly right. You think about it >> That's exactly right. You think about it as as as >> There was I remember when I was getting >> There was I remember when I was getting >> There was I remember when I was getting my psychology degree my psychology degree my psychology degree and they were teaching us about and they were teaching us about and they were teaching us about paradigms and I was like I trying to paradigms and I was like I trying to paradigms and I was like I trying to understand how the paradigms shifted understand how the paradigms shifted understand how the paradigms shifted and uh the professor said to me, uh and uh the professor said to me, uh and uh the professor said to me, uh Jason Jason Jason uh what you have to understand is uh what you have to understand is uh what you have to understand is paradigms don't die. paradigms don't die. paradigms don't die. >> They don't. >> They don't. >> They don't. >> People do. >> People do. >> People do. >> That's right. >> That's right. >> That's right. That's how Freud [snorts] Freud and Skinner and Young, like it Freud and Skinner and Young, like it took them dying took them dying took them dying >> That's right. It took the new generation >> That's right. It took the new generation >> That's right. It took the new generation the new generation to question it and the new generation to question it and the new generation to question it and that was 20 years. that was 20 years. that was 20 years. >> Yeah, sometimes 40 years. >> Yeah, sometimes 40 years. >> Yeah, sometimes 40 years. >> Right. As their students maintained >> Right. As their students maintained >> Right. As their students maintained positions of leadership until someone positions of leadership until someone positions of leadership until someone said, maybe we can do it differently. said, maybe we can do it differently. said, maybe we can do it differently. And I I think what you're seeing is this And I I think what you're seeing is this And I I think what you're seeing is this iteration is a iteration is a iteration is a shortening of the shortening of the shortening of the the the intergenerational gap the the intergenerational gap the the intergenerational gap and the learning is so fast. and the learning is so fast. and the learning is so fast. >> It's uh always so great to talk to you >> It's uh always so great to talk to you >> It's uh always so great to talk to you because uh one, it's just intellectually because uh one, it's just intellectually because uh one, it's just intellectually uh uh uh so your your approach to it is so so your your approach to it is so so your your approach to it is so intellectually rigorous, but also um intellectually rigorous, but also um intellectually rigorous, but also um with so much P Doom in the world with so much P Doom in the world with so much P Doom in the world I I feel so good that you're such an I I feel so good that you're such an I I feel so good that you're such an optimist about this technology and optimist about this technology and optimist about this technology and you're building it you're building it you're building it with such thoughtfulness and it I think with such thoughtfulness and it I think with such thoughtfulness and it I think for people who are hearing these horror for people who are hearing these horror for people who are hearing these horror stories about AI and job loss and stories about AI and job loss and stories about AI and job loss and everything everything everything they need to understand there are people they need to understand there are people they need to understand there are people like yourself who are building this in like yourself who are building this in like yourself who are building this in an incredibly thoughtful way and this is an incredibly thoughtful way and this is an incredibly thoughtful way and this is going to be a net benefit for humanity going to be a net benefit for humanity going to be a net benefit for humanity >> [snorts] >> [snorts] >> [snorts] >> that >> that >> that just is unimaginable. just is unimaginable. just is unimaginable. >> Yeah. We have a shot >> Yeah. We have a shot >> Yeah. We have a shot with this technology with this technology with this technology so no not our children nor anyone they so no not our children nor anyone they so no not our children nor anyone they know dies of cancer. know dies of cancer. know dies of cancer. Right? I mean, say it like that you Right? I mean, say it like that you Right? I mean, say it like that you there will be some dislocation in the there will be some dislocation in the there will be some dislocation in the economy. There will be. There was economy. There will be. There was economy. There will be. There was dislocation when cars came and and and dislocation when cars came and and and dislocation when cars came and and and it was a bad deal to to to be a guy who it was a bad deal to to to be a guy who it was a bad deal to to to be a guy who shoed horses, right? Or built carriages. shoed horses, right? Or built carriages. shoed horses, right? Or built carriages. >> Yeah. >> Yeah. >> Yeah. >> But you got to also against that, you >> But you got to also against that, you >> But you got to also against that, you know, make your tea of the cons and the know, make your tea of the cons and the know, make your tea of the cons and the pros. pros. pros. >> Yeah. >> Yeah. >> Yeah. >> Right? There's a shot that our children >> Right? There's a shot that our children >> Right? There's a shot that our children none of them nor their people they love none of them nor their people they love none of them nor their people they love will die of cancer. will die of cancer. will die of cancer. And that that's one. And that that's one. And that that's one. >> That's funny. >> That's funny. >> That's funny. >> that we can work on with this technology >> that we can work on with this technology >> that we can work on with this technology and we will have great purchase on. And and we will have great purchase on. And and we will have great purchase on. And [snorts] and I think you begin listing [snorts] and I think you begin listing [snorts] and I think you begin listing those and then it's a more thoughtful those and then it's a more thoughtful those and then it's a more thoughtful discussion. discussion. discussion. >> Yeah, unlimited energy, unlimited >> Yeah, unlimited energy, unlimited >> Yeah, unlimited energy, unlimited calories, unlimited knowledge, unlimited calories, unlimited knowledge, unlimited calories, unlimited knowledge, unlimited education, unlimited housing. education, unlimited housing. education, unlimited housing. >> And how we do it. We imagine imagine >> And how we do it. We imagine imagine >> And how we do it. We imagine imagine sort of sort of sort of we know how to teach children and we we know how to teach children and we we know how to teach children and we don't do it, right? Aristotle was a don't do it, right? Aristotle was a don't do it, right? Aristotle was a tutor to Alexander the Great. Socrates tutor to Alexander the Great. Socrates tutor to Alexander the Great. Socrates was his tutor. We know that if you give was his tutor. We know that if you give was his tutor. We know that if you give a child a tutor and the tutor modifies a child a tutor and the tutor modifies a child a tutor and the tutor modifies the teaching for the child, they learn the teaching for the child, they learn the teaching for the child, they learn better. better. better. >> Adapt. That's not how we do it teaching >> Adapt. That's not how we do it teaching >> Adapt. That's not how we do it teaching classes. classes. classes. >> No, factory farming. >> No, factory farming. >> No, factory farming. >> That's right. We we teach to some sort >> That's right. We we teach to some sort >> That's right. We we teach to some sort of middle level. Imagine if we beat of middle level. Imagine if we beat of middle level. Imagine if we beat built agents that that taught children built agents that that taught children built agents that that taught children for their way of learning. for their way of learning. for their way of learning. >> Right. >> Right. >> Right. >> Right? And here's the way we we've been >> Right? And here's the way we we've been >> Right? And here's the way we we've been doing it the same way for a thousand doing it the same way for a thousand doing it the same way for a thousand years and during that entire time we years and during that entire time we years and during that entire time we knew how to do it better and we chose knew how to do it better and we chose knew how to do it better and we chose not to. not to. not to. >> Yeah. >> Yeah. >> Yeah. >> And and here's the way we can do it. Put >> And and here's the way we can do it. Put >> And and here's the way we can do it. Put that on the pro side. And so as long as that on the pro side. And so as long as that on the pro side. And so as long as we're sort of thoughtfully and fairly we're sort of thoughtfully and fairly we're sort of thoughtfully and fairly writing the good and the bad, I I think writing the good and the bad, I I think writing the good and the bad, I I think it'll come out okay. it'll come out okay. it'll come out okay. >> get out there Andrew and keep >> get out there Andrew and keep >> get out there Andrew and keep communicating your version of the world communicating your version of the world communicating your version of the world because some folk people see around the because some folk people see around the because some folk people see around the corner and they get a little nervous and corner and they get a little nervous and corner and they get a little nervous and okay, fair enough, but I think the okay, fair enough, but I think the okay, fair enough, but I think the ledger as you describe it ledger as you describe it ledger as you describe it is heavily weighted towards abundance. is heavily weighted towards abundance. is heavily weighted towards abundance. >> I think it'll create abundance for sure. >> I think it'll create abundance for sure. >> I think it'll create abundance for sure. >> abundance. >> abundance. >> abundance. >> Andrew, pleasure always. I'll see you in >> Andrew, pleasure always. I'll see you in >> Andrew, pleasure always. I'll see you in I'll see you in 6 months for our I'll see you in 6 months for our I'll see you in 6 months for our checkup. That'll be great. checkup. That'll be great. checkup. That'll be great. >> I'm going all in. >> I'm going all in. >> I'm going all in. >> Industries capital and intelligence are >> Industries capital and intelligence are >> Industries capital and intelligence are converging into a single interconnected converging into a single interconnected converging into a single interconnected system and the infrastructure behind it system and the infrastructure behind it system and the infrastructure behind it needs to evolve just as quickly. Nasdaq needs to evolve just as quickly. Nasdaq needs to evolve just as quickly. Nasdaq was built for this moment powering more was built for this moment powering more was built for this moment powering more than 135 marketplaces and regulators than 135 marketplaces and regulators than 135 marketplaces and regulators globally and connecting capital to globally and connecting capital to globally and connecting capital to companies shaping the future. As the companies shaping the future. As the companies shaping the future. As the innovation economy accelerates innovation economy accelerates innovation economy accelerates connectivity becomes the critical asset. connectivity becomes the critical asset. connectivity becomes the critical asset. Nasdaq is the leading technology Nasdaq is the leading technology Nasdaq is the leading technology platform that makes it possible and platform that makes it possible and platform that makes it possible and scalable. Learn more at nasdaq.com. scalable. Learn more at nasdaq.com. scalable. Learn more at nasdaq.com. >> I'm going all in. >> I'm going all in. >> I'm going all in. >> Robin Rombach is the co-founder and CEO >> Robin Rombach is the co-founder and CEO >> Robin Rombach is the co-founder and CEO of Black Forest Labs. of Black Forest Labs. of Black Forest Labs. You are based in Germany in Black Forest You are based in Germany in Black Forest You are based in Germany in Black Forest which is a city which is a city which is a city in Germany. in Germany. in Germany. >> a mountain range actually. >> a mountain range actually. >> a mountain range actually. >> A mountain range. >> A mountain range. >> A mountain range. >> Yes. >> Yes. >> Yes. >> Where you grew up. >> Where you grew up. >> Where you grew up. >> Well, I grew up this. >> Well, I grew up this. >> Well, I grew up this. >> And you are working on open-source image >> And you are working on open-source image >> And you are working on open-source image and video models. and video models. and video models. You worked at stable diffusion for a You worked at stable diffusion for a You worked at stable diffusion for a little bit. little bit. little bit. >> That's correct. >> That's correct. >> That's correct. >> Cut your teeth on that and you're known >> Cut your teeth on that and you're known >> Cut your teeth on that and you're known for the open-source model flux. And for the open-source model flux. And for the open-source model flux. And maybe also for some closed-source maybe also for some closed-source maybe also for some closed-source models. Tell us about the business of models. Tell us about the business of models. Tell us about the business of Black Forest Labs. What is the business Black Forest Labs. What is the business Black Forest Labs. What is the business and what is the goal? and what is the goal? and what is the goal? >> 100% >> 100% >> 100% one quick addition. We are based in the one quick addition. We are based in the one quick addition. We are based in the Black Forest. It's a town called Black Forest. It's a town called Black Forest. It's a town called Freiburg and in San Francisco. Freiburg and in San Francisco. Freiburg and in San Francisco. >> Oh, and in San Francisco of course, >> Oh, and in San Francisco of course, >> Oh, and in San Francisco of course, yeah. yeah. yeah. >> Um we >> Um we >> Um we >> You're splitting your time or >> You're splitting your time or >> You're splitting your time or >> I'm splitting my time to a certain >> I'm splitting my time to a certain >> I'm splitting my time to a certain degree. degree. degree. We We We yeah, started a company 2 years ago. yeah, started a company 2 years ago. yeah, started a company 2 years ago. Me and my co-founders as you said like Me and my co-founders as you said like Me and my co-founders as you said like we've worked on stable diffusion in the we've worked on stable diffusion in the we've worked on stable diffusion in the past. Before that we invented like an past. Before that we invented like an past. Before that we invented like an algorithm called latent diffusion which algorithm called latent diffusion which algorithm called latent diffusion which is basically like the fundamental is basically like the fundamental is basically like the fundamental algorithm behind all of like generative algorithm behind all of like generative algorithm behind all of like generative models that are being deployed for image models that are being deployed for image models that are being deployed for image generation, video generation, even like generation, video generation, even like generation, video generation, even like physical AI now. physical AI now. physical AI now. >> Yeah. >> Yeah. >> Yeah. >> It basically makes use of this principle >> It basically makes use of this principle >> It basically makes use of this principle that you can compress natural data such that you can compress natural data such that you can compress natural data such as images, such as video, such as audio as images, such as video, such as audio as images, such as video, such as audio into much more like efficient into much more like efficient into much more like efficient representation representation representation and then train a transformer model on and then train a transformer model on and then train a transformer model on that. that. that. And um And um And um I mean this is the stuff where like you I mean this is the stuff where like you I mean this is the stuff where like you know, like JPEG, know, like JPEG, know, like JPEG, MP3 and all of that works. And we MP3 and all of that works. And we MP3 and all of that works. And we basically translated that into like a basically translated that into like a basically translated that into like a neural algorithm neural algorithm neural algorithm a few years ago when we were still like a few years ago when we were still like a few years ago when we were still like PhD students in in Munich actually. PhD students in in Munich actually. PhD students in in Munich actually. And then build on like And then build on like And then build on like on top of that we built stable diffusion on top of that we built stable diffusion on top of that we built stable diffusion and then and then and then on top of that yeah, uh the generative models that we are the generative models that we are developing today. And of course like the developing today. And of course like the developing today. And of course like the technology has advanced. technology has advanced. technology has advanced. Um but we are now tackling Um but we are now tackling Um but we are now tackling I would say models that are I would say models that are I would say models that are really made for really made for really made for understanding like the whole world understanding like the whole world understanding like the whole world around us. Multi-modal visual models around us. Multi-modal visual models around us. Multi-modal visual models pre-trained on images, videos, audio pre-trained on images, videos, audio pre-trained on images, videos, audio data at the same time. data at the same time. data at the same time. And we are now like entering a new And we are now like entering a new And we are now like entering a new paradigm which is combining that with paradigm which is combining that with paradigm which is combining that with something that's called action something that's called action something that's called action prediction prediction prediction such that you can actually use the same such that you can actually use the same such that you can actually use the same model to make images, to make videos, to model to make images, to make videos, to model to make images, to make videos, to make audio, make audio, make audio, and to predict actions which means you and to predict actions which means you and to predict actions which means you can ultimately deploy it on a robot in can ultimately deploy it on a robot in can ultimately deploy it on a robot in the real world. the real world. the real world. >> Wow. So from the image >> Wow. So from the image >> Wow. So from the image to the video, the audio and then to the video, the audio and then to the video, the audio and then eventually the real world with robotics eventually the real world with robotics eventually the real world with robotics and a real world model because if you and a real world model because if you and a real world model because if you can make the image can make the image can make the image you and you can train the model, that you and you can train the model, that you and you can train the model, that means by default you understand the means by default you understand the means by default you understand the world. In order to make a video of the world. In order to make a video of the world. In order to make a video of the world, you have to understand the world, world, you have to understand the world, world, you have to understand the world, yeah? yeah? yeah? >> [snorts] >> [snorts] >> [snorts] >> And the objects in it. >> And the objects in it. >> And the objects in it. >> I think that's yeah, I think that's like >> I think that's yeah, I think that's like >> I think that's yeah, I think that's like a a really good like way to think about a a really good like way to think about a a really good like way to think about it. It's like it's like an intuitive way it. It's like it's like an intuitive way it. It's like it's like an intuitive way to to to interact with the world, right? Like interact with the world, right? Like interact with the world, right? Like I I would say there's like these like I I would say there's like these like I I would say there's like these like complementary forms of intelligence complementary forms of intelligence complementary forms of intelligence ultimately. There's like intuitive ultimately. There's like intuitive ultimately. There's like intuitive intelligence and then there's like a intelligence and then there's like a intelligence and then there's like a deep reasoning layer. Now, ultimately, deep reasoning layer. Now, ultimately, deep reasoning layer. Now, ultimately, you need for like a kind of like you need for like a kind of like you need for like a kind of like complete form, you need both. complete form, you need both. complete form, you need both. And you need them to interact, and I And you need them to interact, and I And you need them to interact, and I think like we've been approaching it think like we've been approaching it think like we've been approaching it more from like the intuitive side. more from like the intuitive side. more from like the intuitive side. Images is like a very natural way to Images is like a very natural way to Images is like a very natural way to approach this whole field because it's approach this whole field because it's approach this whole field because it's not as computationally intensive as, not as computationally intensive as, not as computationally intensive as, let's say, video, right? let's say, video, right? let's say, video, right? >> [snorts] >> [snorts] >> [snorts] >> But now, yeah, I think like we're >> But now, yeah, I think like we're >> But now, yeah, I think like we're combining it. It's converging into like combining it. It's converging into like combining it. It's converging into like a a a a more multimodal model, and yeah, we a more multimodal model, and yeah, we a more multimodal model, and yeah, we see like exactly like pre-training on see like exactly like pre-training on see like exactly like pre-training on videos gives like implicit understanding videos gives like implicit understanding videos gives like implicit understanding of the physics of interactions with the of the physics of interactions with the of the physics of interactions with the real world. real world. real world. And then you can get stuff like action And then you can get stuff like action And then you can get stuff like action prediction like robotics out of the same prediction like robotics out of the same prediction like robotics out of the same model. model. model. >> And >> And >> And with these models and the training, with these models and the training, with these models and the training, they're kind of they're kind of they're kind of been a limitation in creating videos, in been a limitation in creating videos, in been a limitation in creating videos, in creating images where creating images where creating images where the criticism of the criticism of the criticism of generative AI is it's a bit of a slot generative AI is it's a bit of a slot generative AI is it's a bit of a slot machine. I give a prompt, it gives me machine. I give a prompt, it gives me machine. I give a prompt, it gives me something back. something back. something back. But how did it come up with that? The But how did it come up with that? The But how did it come up with that? The training data, but training data, but training data, but you know, maybe I want a different you know, maybe I want a different you know, maybe I want a different style. Maybe I want style. Maybe I want style. Maybe I want a different color. Maybe I want a a different color. Maybe I want a a different color. Maybe I want a different different different you know, aesthetic. you know, aesthetic. you know, aesthetic. >> Yep. >> Yep. >> Yep. >> It has that How does that problem get >> It has that How does that problem get >> It has that How does that problem get solved? solved? solved? And do you actually understand what's And do you actually understand what's And do you actually understand what's happening happening happening when the image is being made under the when the image is being made under the when the image is being made under the hood? Yeah. hood? Yeah. hood? Yeah. >> Yeah, I I think >> Yeah, I I think >> Yeah, I I think like ultimately, it's about like like ultimately, it's about like like ultimately, it's about like exposing as many like manipulation exposing as many like manipulation exposing as many like manipulation layers as possible to layers as possible to layers as possible to like I don't know, like a user or like I don't know, like a user or like I don't know, like a user or developer that builds on top of this developer that builds on top of this developer that builds on top of this model, right? And I think like we've model, right? And I think like we've model, right? And I think like we've seen that in the past with seen that in the past with seen that in the past with like in the past, image models they like in the past, image models they like in the past, image models they basically started from simple basically started from simple basically started from simple text-to-image systems. Right. Then they text-to-image systems. Right. Then they text-to-image systems. Right. Then they have expanded into text-plus-image to have expanded into text-plus-image to have expanded into text-plus-image to image systems, which means you could image systems, which means you could image systems, which means you could suddenly uh take an image, like a real suddenly uh take an image, like a real suddenly uh take an image, like a real image or a generated image, uh and image or a generated image, uh and image or a generated image, uh and iterate on that based on a text prompt, iterate on that based on a text prompt, iterate on that based on a text prompt, like edit it, like edit it, like edit it, modify it, right? modify it, right? modify it, right? And then this expanded into taking And then this expanded into taking And then this expanded into taking multiple images multiple images multiple images and a text prompt and combining them in and a text prompt and combining them in and a text prompt and combining them in a in a semantic way and producing new a in a semantic way and producing new a in a semantic way and producing new content. And the same principle now content. And the same principle now content. And the same principle now applies to video, and I think now it applies to video, and I think now it applies to video, and I think now it becomes actually even more interesting becomes actually even more interesting becomes actually even more interesting when like all of these like modalities when like all of these like modalities when like all of these like modalities are actually combined inputs and outputs are actually combined inputs and outputs are actually combined inputs and outputs of the same model. of the same model. of the same model. >> So let's talk about video. >> So let's talk about video. >> So let's talk about video. There's an announcement that you're There's an announcement that you're There's an announcement that you're working with the greatest director of working with the greatest director of working with the greatest director of all time, or living director, Martin all time, or living director, Martin all time, or living director, Martin Scorsese. We'll talk about that in a Scorsese. We'll talk about that in a Scorsese. We'll talk about that in a second, yeah? second, yeah? second, yeah? >> Fantastic. >> Fantastic. >> Fantastic. >> Uh but >> Uh but >> Uh but in a movie, uh this promise of being in a movie, uh this promise of being in a movie, uh this promise of being able to make able to make able to make a movie in which the camera angle a movie in which the camera angle a movie in which the camera angle uh the sound uh the sound uh the sound uh could be uh could be uh could be something that a Martin Scorsese would something that a Martin Scorsese would something that a Martin Scorsese would be proud be proud be proud to release to his fans. How close are to release to his fans. How close are to release to his fans. How close are we, and maybe tell us a little bit about we, and maybe tell us a little bit about we, and maybe tell us a little bit about this partnership? this partnership? this partnership? The technology being able to make The technology being able to make The technology being able to make an actual movie like Goodfellas, or a an actual movie like Goodfellas, or a an actual movie like Goodfellas, or a scene from Goodfellas, uh scene from Goodfellas, uh scene from Goodfellas, uh versus where it is today, where you can versus where it is today, where you can versus where it is today, where you can make interesting five or 10-second make interesting five or 10-second make interesting five or 10-second clips, and then maybe uh people struggle clips, and then maybe uh people struggle clips, and then maybe uh people struggle making 10 of them, and then they use making 10 of them, and then they use making 10 of them, and then they use some post-editing software to put them some post-editing software to put them some post-editing software to put them together, but you immediately understand together, but you immediately understand together, but you immediately understand this is not this is not this is not that. It's not a movie. It's that. It's not a movie. It's that. It's not a movie. It's AI slop. It's AI slop. It's AI slop. It's kludgy. It's doesn't pass the uncanny kludgy. It's doesn't pass the uncanny kludgy. It's doesn't pass the uncanny valley. valley. valley. >> Well, I think >> Well, I think >> Well, I think it's important, and that's at least like it's important, and that's at least like it's important, and that's at least like the view that we have, is that the view that we have, is that the view that we have, is that these AI models, they are a medium, these AI models, they are a medium, these AI models, they are a medium, right? They We don't want to set like right? They We don't want to set like right? They We don't want to set like any way of how they are supposed to be any way of how they are supposed to be any way of how they are supposed to be used. We don't want to tell anyone, used. We don't want to tell anyone, used. We don't want to tell anyone, especially not someone like Martin especially not someone like Martin especially not someone like Martin Scorsese, how he how is he supposed to Scorsese, how he how is he supposed to Scorsese, how he how is he supposed to use his model. Like he's one of the like use his model. Like he's one of the like use his model. Like he's one of the like greatest filmmakers ever. greatest filmmakers ever. greatest filmmakers ever. It was insane sitting in the same room It was insane sitting in the same room It was insane sitting in the same room with him multiple times and actually him with him multiple times and actually him with him multiple times and actually him seeing like exploring our models like as seeing like exploring our models like as seeing like exploring our models like as like one of the like core researchers like one of the like core researchers like one of the like core researchers behind it was like just behind it was like just behind it was like just an insane feeling, right? And at the an insane feeling, right? And at the an insane feeling, right? And at the same time I'm also like a big fan. Um same time I'm also like a big fan. Um same time I'm also like a big fan. Um >> So you sat in a room with Marty Scorsese >> So you sat in a room with Marty Scorsese >> So you sat in a room with Marty Scorsese and showed him your tools. and showed him your tools. and showed him your tools. >> Exactly, yeah. >> Exactly, yeah. >> Exactly, yeah. >> And what was his reaction? What what did >> And what was his reaction? What what did >> And what was his reaction? What what did he key off of? What was the thing that he key off of? What was the thing that he key off of? What was the thing that he found most inspiring or interesting? he found most inspiring or interesting? he found most inspiring or interesting? >> Um I think it was really this idea of >> Um I think it was really this idea of >> Um I think it was really this idea of like he has clearly like he has clearly like he has clearly um a a vision in his head um a a vision in his head um a a vision in his head of like a scene or of like a scene or of like a scene or a scenery where like maybe a a new movie a scenery where like maybe a a new movie a scenery where like maybe a a new movie um will be shot. um will be shot. um will be shot. And he's trying to explore that and kind And he's trying to explore that and kind And he's trying to explore that and kind of like um we we we basically looked at of like um we we we basically looked at of like um we we we basically looked at the scenery of like a village in Eastern the scenery of like a village in Eastern the scenery of like a village in Eastern Europe somewhere and he was describing Europe somewhere and he was describing Europe somewhere and he was describing it. We saw some outputs, we iterated on it. We saw some outputs, we iterated on it. We saw some outputs, we iterated on the outputs the outputs the outputs um and ultimately I think and that's um and ultimately I think and that's um and ultimately I think and that's what he said in the end is like the like what he said in the end is like the like what he said in the end is like the like getting like the mental picture of getting like the mental picture of getting like the mental picture of something out of your head and something out of your head and something out of your head and communicating it in a visual way communicating it in a visual way communicating it in a visual way by making like these images by making like these images by making like these images um or the series of images um um or the series of images um um or the series of images um is something that it just makes it like is something that it just makes it like is something that it just makes it like easier to communicate and convey convey easier to communicate and convey convey easier to communicate and convey convey like an idea of like what is actually in like an idea of like what is actually in like an idea of like what is actually in your head and I think that's like one of your head and I think that's like one of your head and I think that's like one of the like the like the like very interesting and powerful ways to very interesting and powerful ways to very interesting and powerful ways to use this technology. And I think use this technology. And I think use this technology. And I think ultimately ultimately ultimately >> is to get the inspiration to get the >> is to get the inspiration to get the >> is to get the inspiration to get the vision out of his head vision out of his head vision out of his head onto an image. onto an image. onto an image. >> Yeah, I mean like language ultimately is >> Yeah, I mean like language ultimately is >> Yeah, I mean like language ultimately is like a little bit of like a lossy um like a little bit of like a lossy um like a little bit of like a lossy um communication medium, right? communication medium, right? communication medium, right? >> Yeah. >> Yeah. >> Yeah. >> Um it's also interpreted in different >> Um it's also interpreted in different >> Um it's also interpreted in different ways, but then visual information is so ways, but then visual information is so ways, but then visual information is so rich so rich uh like an an image or a rich so rich uh like an an image or a rich so rich uh like an an image or a video there's so much signal in it and video there's so much signal in it and video there's so much signal in it and it's just like another way of it's just like another way of it's just like another way of communicating. communicating. communicating. And I think that's like one of the And I think that's like one of the And I think that's like one of the beautiful things that this technology beautiful things that this technology beautiful things that this technology ultimately enables and I think like to ultimately enables and I think like to ultimately enables and I think like to your question of your question of your question of making like full movies with making like full movies with making like full movies with I don't know, like a video I don't know, like a video I don't know, like a video generation model for example. generation model for example. generation model for example. I'm not sure if that is like the I'm not sure if that is like the I'm not sure if that is like the ultimate goal. Maybe it's like ultimate goal. Maybe it's like ultimate goal. Maybe it's like interesting to plug this into like some interesting to plug this into like some interesting to plug this into like some kind of a genetic workflow and make like kind of a genetic workflow and make like kind of a genetic workflow and make like a very long video and I think that's a very long video and I think that's a very long video and I think that's really cool to explore, but I think really cool to explore, but I think really cool to explore, but I think ultimately ultimately ultimately like the real interesting use cases, like the real interesting use cases, like the real interesting use cases, they come when you have like a human in they come when you have like a human in they come when you have like a human in the loop who interacts and uses it as a the loop who interacts and uses it as a the loop who interacts and uses it as a medium and I think this is this is at medium and I think this is this is at medium and I think this is this is at least like the perspective that that I least like the perspective that that I least like the perspective that that I take um that makes it interesting and take um that makes it interesting and take um that makes it interesting and that this is most often when the most that this is most often when the most that this is most often when the most interesting outputs um arrive or are interesting outputs um arrive or are interesting outputs um arrive or are actually being made. actually being made. actually being made. >> production level is so obviously a huge >> production level is so obviously a huge >> production level is so obviously a huge win for Gen-AI. win for Gen-AI. win for Gen-AI. >> parallelize your brainstorming >> parallelize your brainstorming >> parallelize your brainstorming basically. basically. basically. >> Yeah. And yeah, I like that. Parallelize >> Yeah. And yeah, I like that. Parallelize >> Yeah. And yeah, I like that. Parallelize your brainstorming. And and they have an your brainstorming. And and they have an your brainstorming. And and they have an analogy for this. They do storyboards. analogy for this. They do storyboards. analogy for this. They do storyboards. And some of the great directors, Ridley And some of the great directors, Ridley And some of the great directors, Ridley Scott of Aliens and Gladiator, was known Scott of Aliens and Gladiator, was known Scott of Aliens and Gladiator, was known for making his own. I also believe for making his own. I also believe for making his own. I also believe Spielberg was also like to sketch Spielberg was also like to sketch Spielberg was also like to sketch Raiders of the Lost Ark and some of Raiders of the Lost Ark and some of Raiders of the Lost Ark and some of these. George Lucas was known for these. George Lucas was known for these. George Lucas was known for collaborating with many amazing artists, collaborating with many amazing artists, collaborating with many amazing artists, um even making miniatures and making um even making miniatures and making um even making miniatures and making storyboards for the Star Wars franchise. storyboards for the Star Wars franchise. storyboards for the Star Wars franchise. He had those people on full-time helping He had those people on full-time helping He had those people on full-time helping him with that. So, that's the obvious him with that. So, that's the obvious him with that. So, that's the obvious place to start. But, if we look at place to start. But, if we look at place to start. But, if we look at startups, startups, startups, startups uh always want to try to figure startups uh always want to try to figure startups uh always want to try to figure out how to do something cheaply. And out how to do something cheaply. And out how to do something cheaply. And people used to make a launch video for people used to make a launch video for people used to make a launch video for their startup for, you know, $100,000, their startup for, you know, $100,000, their startup for, you know, $100,000, $250,000. So, they take their $10 $250,000. So, they take their $10 $250,000. So, they take their $10 million million million venture raise and spend $250,000 on a venture raise and spend $250,000 on a venture raise and spend $250,000 on a launch video. I've seen it with [snorts] launch video. I've seen it with [snorts] launch video. I've seen it with [snorts] a lot of the startups I'm investing in a lot of the startups I'm investing in a lot of the startups I'm investing in now. They'll just spend a week or two now. They'll just spend a week or two now. They'll just spend a week or two working with [snorts] working with [snorts] working with [snorts] um um um you know, uh a director to make uh a you know, uh a director to make uh a you know, uh a director to make uh a launch video. You've probably seen this launch video. You've probably seen this launch video. You've probably seen this trend, yeah? And I'm sure people use trend, yeah? And I'm sure people use trend, yeah? And I'm sure people use Flux and some of your models for this. Flux and some of your models for this. Flux and some of your models for this. Uh Uh Uh have you seen this? have you seen this? have you seen this? >> Yeah, of course, yeah. >> Yeah, of course, yeah. >> Yeah, of course, yeah. >> Yeah, what what's your take on that? >> Yeah, what what's your take on that? >> Yeah, what what's your take on that? Because that feels like the early stage Because that feels like the early stage Because that feels like the early stage of storytelling. You're trying to of storytelling. You're trying to of storytelling. You're trying to communicate a product or service in a communicate a product or service in a communicate a product or service in a fun, engaging, punchy, 30-second, fun, engaging, punchy, 30-second, fun, engaging, punchy, 30-second, 90-second way, yeah? 90-second way, yeah? 90-second way, yeah? >> I mean, like, again, like, I think >> I mean, like, again, like, I think >> I mean, like, again, like, I think we support these like exploration based we support these like exploration based we support these like exploration based on these tools, right? And um I think on these tools, right? And um I think on these tools, right? And um I think like ultimately it's great to see like like ultimately it's great to see like like ultimately it's great to see like all different kind of like all different kind of like all different kind of like I don't know, like, launch videos, uh I don't know, like, launch videos, uh I don't know, like, launch videos, uh products being built on top of like the products being built on top of like the products being built on top of like the same kind of like base model or the same same kind of like base model or the same same kind of like base model or the same technology. technology. technology. Um and I think that's what's making it Um and I think that's what's making it Um and I think that's what's making it so interesting and also so powerful. so interesting and also so powerful. so interesting and also so powerful. >> Yeah. >> Yeah. >> Yeah. And what else are people using the And what else are people using the And what else are people using the technology for? I understand there's a technology for? I understand there's a technology for? I understand there's a Bitcoin movie coming out. Instead of Bitcoin movie coming out. Instead of Bitcoin movie coming out. Instead of using a green screen in this Bitcoin using a green screen in this Bitcoin using a green screen in this Bitcoin movie, movie, movie, um I was talking to Gal Gadot, you know, um I was talking to Gal Gadot, you know, um I was talking to Gal Gadot, you know, the woman who played the actress who the woman who played the actress who the woman who played the actress who played Wonder Woman. played Wonder Woman. played Wonder Woman. >> Yeah, Gal Gadot. Gal, of course. >> Yeah, Gal Gadot. Gal, of course. >> Yeah, Gal Gadot. Gal, of course. >> She I was talking to her in an event and >> She I was talking to her in an event and >> She I was talking to her in an event and she was telling me she was telling me she was telling me um it was the Breakthrough Prize uh Yuri um it was the Breakthrough Prize uh Yuri um it was the Breakthrough Prize uh Yuri Milner's event and she was telling me Milner's event and she was telling me Milner's event and she was telling me she just did a Bitcoin movie she just did a Bitcoin movie she just did a Bitcoin movie and they did it on a sound stage without and they did it on a sound stage without and they did it on a sound stage without green screens. green screens. green screens. But all the actors just worked in like a But all the actors just worked in like a But all the actors just worked in like a sound stage and then all of the scenery sound stage and then all of the scenery sound stage and then all of the scenery behind them was being done by generative behind them was being done by generative behind them was being done by generative AI. That's a real movie. That's a $30 AI. That's a real movie. That's a $30 AI. That's a real movie. That's a $30 million budget movie. She said it would million budget movie. She said it would million budget movie. She said it would have cost $150 million have cost $150 million have cost $150 million if they had to build sets and the film if they had to build sets and the film if they had to build sets and the film would have never been greenlit. Are you would have never been greenlit. Are you would have never been greenlit. Are you starting to see people use that in starting to see people use that in starting to see people use that in production, not just in the back end and production, not just in the back end and production, not just in the back end and the animation phase, but actually in the animation phase, but actually in the animation phase, but actually in production yet with your tools? production yet with your tools? production yet with your tools? >> Yeah. Um yeah, we see some use cases >> Yeah. Um yeah, we see some use cases >> Yeah. Um yeah, we see some use cases like that in production. I think like like that in production. I think like like that in production. I think like high-end film production is kind of like high-end film production is kind of like high-end film production is kind of like the one of the like most demanding use the one of the like most demanding use the one of the like most demanding use cases and I I think I'm glad that it's cases and I I think I'm glad that it's cases and I I think I'm glad that it's being explored, but I also being explored, but I also being explored, but I also really want to um really want to um really want to um like it's I think it's important to see like it's I think it's important to see like it's I think it's important to see that this technology is like on a that this technology is like on a that this technology is like on a trajectory and it's improving. It's trajectory and it's improving. It's trajectory and it's improving. It's improving rapidly. I don't know, if I improving rapidly. I don't know, if I improving rapidly. I don't know, if I look back at like where we started like look back at like where we started like look back at like where we started like a few years ago when I was doing my PhD a few years ago when I was doing my PhD a few years ago when I was doing my PhD in this field like the only thing that in this field like the only thing that in this field like the only thing that you could do was like you could do was like you could do was like images of 64 by 64 pixels. Now you can images of 64 by 64 pixels. Now you can images of 64 by 64 pixels. Now you can do like multi-minute videos, right? And do like multi-minute videos, right? And do like multi-minute videos, right? And like a high resolution. But it's like like a high resolution. But it's like like a high resolution. But it's like it's not going to stop there. It's going it's not going to stop there. It's going it's not going to stop there. It's going to it's going to continue to improve and to it's going to continue to improve and to it's going to continue to improve and I think like then it's I think like then it's I think like then it's going to unlock like even more of these going to unlock like even more of these going to unlock like even more of these like high-end use cases. But I think like high-end use cases. But I think like high-end use cases. But I think like like like the main thing the main thing the main thing >> we get to that? Yeah. >> we get to that? Yeah. >> we get to that? Yeah. >> How to predict I think how to predict >> How to predict I think how to predict >> How to predict I think how to predict and I think ultimately and I think ultimately and I think ultimately >> of years. >> of years. >> of years. >> Ultimately I think you still want to >> Ultimately I think you still want to >> Ultimately I think you still want to have like the tool that enables like have like the tool that enables like have like the tool that enables like this human in the loop kind of this human in the loop kind of this human in the loop kind of >> Of course, yeah. >> Of course, yeah. >> Of course, yeah. >> Um >> Um >> Um production workflow, right? production workflow, right? production workflow, right? But I think But I think But I think when I look at when I look at when I look at multimodal generative models as a whole, multimodal generative models as a whole, multimodal generative models as a whole, I think what really excites me is I think what really excites me is I think what really excites me is you can use the same kind of you can use the same kind of you can use the same kind of um AI model to make a movie and deploy um AI model to make a movie and deploy um AI model to make a movie and deploy that as a brain on a robot. Uh and I that as a brain on a robot. Uh and I that as a brain on a robot. Uh and I think this is like this is so think this is like this is so think this is like this is so interesting. Um and I don't know like interesting. Um and I don't know like interesting. Um and I don't know like there's like some thoughts around trying there's like some thoughts around trying there's like some thoughts around trying that that that in the digital world, right? This which in the digital world, right? This which in the digital world, right? This which would be for example computer use would be for example computer use would be for example computer use remains to be seen if that is actually remains to be seen if that is actually remains to be seen if that is actually something that works or not. But I think something that works or not. But I think something that works or not. But I think like the technology is so powerful and like the technology is so powerful and like the technology is so powerful and so versatile. so versatile. so versatile. And it's just just moving into that. And it's just just moving into that. And it's just just moving into that. You know the all the talk around like You know the all the talk around like You know the all the talk around like world models, world action models, all world models, world action models, all world models, world action models, all of that it's basically all the same. of that it's basically all the same. of that it's basically all the same. And I think that's what's making it so And I think that's what's making it so And I think that's what's making it so interesting and what I find like most interesting and what I find like most interesting and what I find like most exciting. exciting. exciting. >> So, >> So, >> So, do you believe that the technology will do you believe that the technology will do you believe that the technology will be used to analyze or primarily to be used to analyze or primarily to be used to analyze or primarily to analyze real world? Like here is a video analyze real world? Like here is a video analyze real world? Like here is a video of somebody of somebody of somebody you know, making you know, making you know, making a sandwich. Now we have the robot study a sandwich. Now we have the robot study a sandwich. Now we have the robot study it and make the sandwich or do you think it and make the sandwich or do you think it and make the sandwich or do you think they'll be a lot of synthetic data made they'll be a lot of synthetic data made they'll be a lot of synthetic data made that then the robots will just study the that then the robots will just study the that then the robots will just study the synthetic or they're going to just in synthetic or they're going to just in synthetic or they're going to just in some way innately know based on all this some way innately know based on all this some way innately know based on all this massive amounts of training data. massive amounts of training data. massive amounts of training data. Um I think it's a combination of Um I think it's a combination of Um I think it's a combination of prediction, right? And pre- prediction prediction, right? And pre- prediction prediction, right? And pre- prediction and is a way of and is a way of and is a way of you can think about it as simulation, as you can think about it as simulation, as you can think about it as simulation, as generation. It's um generation. It's um generation. It's um predicting actions, which is you have to predicting actions, which is you have to predicting actions, which is you have to understand the input, the visual inputs understand the input, the visual inputs understand the input, the visual inputs in order to actually predict a in order to actually predict a in order to actually predict a reasonable next action. reasonable next action. reasonable next action. Um and it's about perception. It's like Um and it's about perception. It's like Um and it's about perception. It's like you can only do that if you understand, you can only do that if you understand, you can only do that if you understand, if you perceive the content, if you perceive the content, if you perceive the content, you can you can only I don't know, like you can you can only I don't know, like you can you can only I don't know, like transform it into a new piece of content transform it into a new piece of content transform it into a new piece of content or predict an action or describe what or predict an action or describe what or predict an action or describe what you actually see in that um scene. And you actually see in that um scene. And you actually see in that um scene. And the And the combination of all of that the And the combination of all of that the And the combination of all of that is I think um is I think um is I think um yeah, is I think what's what's driving yeah, is I think what's what's driving yeah, is I think what's what's driving it. There's not a single one of them. it. There's not a single one of them. it. There's not a single one of them. It's a combination of these tasks. It's a combination of these tasks. It's a combination of these tasks. >> And what's the best way to get that >> And what's the best way to get that >> And what's the best way to get that training data? Do you need to training data? Do you need to training data? Do you need to have people put on glasses, get a have people put on glasses, get a have people put on glasses, get a first-person perspective, have them put first-person perspective, have them put first-person perspective, have them put on gloves so you have that on gloves so you have that on gloves so you have that >> Yeah. >> Yeah. >> Yeah. >> you know, fidelity of understanding, >> you know, fidelity of understanding, >> you know, fidelity of understanding, "Hey, this glass is moving. I'm pouring "Hey, this glass is moving. I'm pouring "Hey, this glass is moving. I'm pouring this glass. I'm putting ice into it." this glass. I'm putting ice into it." this glass. I'm putting ice into it." You know, and and here's how that's You know, and and here's how that's You know, and and here's how that's works and the splashing and the works and the splashing and the works and the splashing and the condensation water so I can pick it up condensation water so I can pick it up condensation water so I can pick it up and not drop it because it's wet on the and not drop it because it's wet on the and not drop it because it's wet on the outside. Or is it going to be just, outside. Or is it going to be just, outside. Or is it going to be just, "Hey, take the corpus of YouTube videos "Hey, take the corpus of YouTube videos "Hey, take the corpus of YouTube videos and the robots know exactly what to do and the robots know exactly what to do and the robots know exactly what to do because they'll find a a thousand videos because they'll find a a thousand videos because they'll find a a thousand videos of people pouring drinks." of people pouring drinks." of people pouring drinks." >> I mean, ultimately I think you would >> I mean, ultimately I think you would >> I mean, ultimately I think you would want to go to a place where you could want to go to a place where you could want to go to a place where you could like prompt a robot in context, right? like prompt a robot in context, right? like prompt a robot in context, right? As you can do with like a language As you can do with like a language As you can do with like a language model. Basically, just tell it, "Hey, model. Basically, just tell it, "Hey, model. Basically, just tell it, "Hey, go and I don't know, pick up this glass go and I don't know, pick up this glass go and I don't know, pick up this glass with the I don't know, orange juice or with the I don't know, orange juice or with the I don't know, orange juice or whatever it is." Yeah, exactly. We're not there yet. Um but I think this We're not there yet. Um but I think this this is like one of the goals and I this is like one of the goals and I this is like one of the goals and I think like think like think like how these models are deployed currently how these models are deployed currently how these models are deployed currently is there's a like a lot of like is there's a like a lot of like is there's a like a lot of like different hardware, different robots different hardware, different robots different hardware, different robots that are running in factories that are running in factories that are running in factories um that all have like some different um that all have like some different um that all have like some different kind of action representation that you kind of action representation that you kind of action representation that you need to kind of tune the models towards, need to kind of tune the models towards, need to kind of tune the models towards, right? So in practice, um what you do is right? So in practice, um what you do is right? So in practice, um what you do is you have like all this like visual you have like all this like visual you have like all this like visual understanding in the models. understanding in the models. understanding in the models. Um Um Um and then you need only a very little bit and then you need only a very little bit and then you need only a very little bit of like a few hours of um fine-tuning of like a few hours of um fine-tuning of like a few hours of um fine-tuning data to data to data to adjust the model on that specific task. adjust the model on that specific task. adjust the model on that specific task. And you I think the goal would be to And you I think the goal would be to And you I think the goal would be to kind of move away from that towards like kind of move away from that towards like kind of move away from that towards like as much as much as much in context as possible. But it is a in context as possible. But it is a in context as possible. But it is a little bit of a research problem. Uh little bit of a research problem. Uh little bit of a research problem. Uh I I think that that has to I I think that that has to I I think that that has to >> has kind of having a moment right now. >> has kind of having a moment right now. >> has kind of having a moment right now. We've been discussing it on the podcast We've been discussing it on the podcast We've been discussing it on the podcast a whole bunch recently. a whole bunch recently. a whole bunch recently. And And And people are also talking about people are also talking about people are also talking about sovereignty. You have companies that own sovereignty. You have companies that own sovereignty. You have companies that own incredible IP libraries. I mentioned incredible IP libraries. I mentioned incredible IP libraries. I mentioned Star Wars before. Disney owns an Star Wars before. Disney owns an Star Wars before. Disney owns an incredible library. incredible library. incredible library. What should your advice What would your What should your advice What would your What should your advice What would your advice be to a company like Disney? advice be to a company like Disney? advice be to a company like Disney? Should they take your open-source Should they take your open-source Should they take your open-source software, train their own models, or software, train their own models, or software, train their own models, or work with you to train their own models work with you to train their own models work with you to train their own models to control it and then, "Hey, this is to control it and then, "Hey, this is to control it and then, "Hey, this is our IP." our IP." our IP." They've already made a point of working They've already made a point of working They've already made a point of working with ChatGPT and saying, "Hey, you you with ChatGPT and saying, "Hey, you you with ChatGPT and saying, "Hey, you you can and cannot use certain characters." can and cannot use certain characters." can and cannot use certain characters." In fact, OpenAI had a relationship with In fact, OpenAI had a relationship with In fact, OpenAI had a relationship with them that's for sure that's no longer them that's for sure that's no longer them that's for sure that's no longer happening. But they officially licensed happening. But they officially licensed happening. But they officially licensed on the output some characters. So how do on the output some characters. So how do on the output some characters. So how do you think about those major IP holders? you think about those major IP holders? you think about those major IP holders? What's your advice to them? Are you in What's your advice to them? Are you in What's your advice to them? Are you in discussions with them? We know about the discussions with them? We know about the discussions with them? We know about the Martin Scorsese Martin Scorsese Martin Scorsese or tour deal. But how do you think about or tour deal. But how do you think about or tour deal. But how do you think about content libraries? content libraries? content libraries? >> I think it is um >> I think it is um >> I think it is um Look, I think like the most interesting Look, I think like the most interesting Look, I think like the most interesting use cases of this like if you think use cases of this like if you think use cases of this like if you think about like content creation um is in about like content creation um is in about like content creation um is in generating something generating something generating something making something that hasn't been there making something that hasn't been there making something that hasn't been there before, right? So that that's a before, right? So that that's a before, right? So that that's a fundamental like fundamental like fundamental like interesting aspect of this technology. interesting aspect of this technology. interesting aspect of this technology. And then I think like yeah, when it And then I think like yeah, when it And then I think like yeah, when it comes to IP, what we implement for comes to IP, what we implement for comes to IP, what we implement for example on like our public-facing tools example on like our public-facing tools example on like our public-facing tools is is is you cannot generate certain IP with you cannot generate certain IP with you cannot generate certain IP with these models, right? And I think that's these models, right? And I think that's these models, right? And I think that's something that is a a sensible approach, something that is a a sensible approach, something that is a a sensible approach, and then yes, we do work with certain IP and then yes, we do work with certain IP and then yes, we do work with certain IP holders to holders to holders to develop models together with them. develop models together with them. develop models together with them. Some of them based on our open-source Some of them based on our open-source Some of them based on our open-source models, some of them based on like our models, some of them based on like our models, some of them based on like our more powerful proprietary models, but I more powerful proprietary models, but I more powerful proprietary models, but I think that is like a very like think that is like a very like think that is like a very like attractive value proposition. attractive value proposition. attractive value proposition. >> do you think that will look like for >> do you think that will look like for >> do you think that will look like for consumers in another couple of years? consumers in another couple of years? consumers in another couple of years? What would What would What would potentially happen when you open up potentially happen when you open up potentially happen when you open up Disney Plus? Disney Plus? Disney Plus? >> I mean, that's a good question. I'm not >> I mean, that's a good question. I'm not >> I mean, that's a good question. I'm not I'm I'm not in Disney, right? So, it's I'm I'm not in Disney, right? So, it's I'm I'm not in Disney, right? So, it's up up to them to decide that, but I up up to them to decide that, but I up up to them to decide that, but I think we want to enable them to build think we want to enable them to build think we want to enable them to build all kinds of stuff that they that they all kinds of stuff that they that they all kinds of stuff that they that they that they envision. And I think we can that they envision. And I think we can that they envision. And I think we can support them. We can support like other support them. We can support like other support them. We can support like other companies in that space to companies in that space to companies in that space to I don't know, integrate the technology I don't know, integrate the technology I don't know, integrate the technology in the best possible way. I think like in the best possible way. I think like in the best possible way. I think like one of the very interesting angles of it one of the very interesting angles of it one of the very interesting angles of it is that it is like it's becoming much is that it is like it's becoming much is that it is like it's becoming much faster, it's becoming more interactive. faster, it's becoming more interactive. faster, it's becoming more interactive. I can envision like a whole bunch of I can envision like a whole bunch of I can envision like a whole bunch of like very interesting interactive like very interesting interactive like very interesting interactive content creation tools that you could content creation tools that you could content creation tools that you could host on Disney Plus Plus or elsewhere. host on Disney Plus Plus or elsewhere. host on Disney Plus Plus or elsewhere. >> I think the most interesting thing I've >> I think the most interesting thing I've >> I think the most interesting thing I've seen in this regard is fan films. seen in this regard is fan films. seen in this regard is fan films. >> Right. >> Right. >> Right. >> So, there is a category before >> So, there is a category before >> So, there is a category before generative AI, fan fiction. People would generative AI, fan fiction. People would generative AI, fan fiction. People would write their own Star Wars story. write their own Star Wars story. write their own Star Wars story. Then there came fan films, Then there came fan films, Then there came fan films, where people would dress up as Jedi where people would dress up as Jedi where people would dress up as Jedi Knights and record their own films. And Knights and record their own films. And Knights and record their own films. And George Lucas said, "As long as you're George Lucas said, "As long as you're George Lucas said, "As long as you're not doing it commercially, you're not not doing it commercially, you're not not doing it commercially, you're not selling it, I give you permission to go selling it, I give you permission to go selling it, I give you permission to go make Jedi movies." And they even make Jedi movies." And they even make Jedi movies." And they even released had them, you know, how-tos on released had them, you know, how-tos on released had them, you know, how-tos on how to make a lightsaber or, you know, how to make a lightsaber or, you know, how to make a lightsaber or, you know, sound files of like how to make a sound files of like how to make a sound files of like how to make a lightsaber sound. lightsaber sound. lightsaber sound. Now, people are taking Now, people are taking Now, people are taking the stories that haven't been told from the stories that haven't been told from the stories that haven't been told from the Star Wars universe, the Star Wars universe, the Star Wars universe, and they're recreating them using AI, and they're recreating them using AI, and they're recreating them using AI, and for the fans, they're becoming quite and for the fans, they're becoming quite and for the fans, they're becoming quite popular on YouTube. Star Wars Stories popular on YouTube. Star Wars Stories popular on YouTube. Star Wars Stories Untold is I think the biggest one. It's Untold is I think the biggest one. It's Untold is I think the biggest one. It's getting millions of views per video getting millions of views per video getting millions of views per video already. already. already. And I think that's really the future is And I think that's really the future is And I think that's really the future is letting the customer base letting the customer base letting the customer base pay a licensing fee or pay a fee, maybe pay a licensing fee or pay a fee, maybe pay a licensing fee or pay a fee, maybe rent software, or maybe based on the rent software, or maybe based on the rent software, or maybe based on the output, and let them be creative with output, and let them be creative with output, and let them be creative with the characters. Let them make their own the characters. Let them make their own the characters. Let them make their own stories. And you could be in a unique stories. And you could be in a unique stories. And you could be in a unique position to empower that. position to empower that. position to empower that. >> Well, 100% I think like if you find like >> Well, 100% I think like if you find like >> Well, 100% I think like if you find like a model that works for like the IP a model that works for like the IP a model that works for like the IP owners, owners, owners, but then also can enable like the super but then also can enable like the super but then also can enable like the super like creative customization use cases, I like creative customization use cases, I like creative customization use cases, I think that's great. Yeah, and I mean think that's great. Yeah, and I mean think that's great. Yeah, and I mean like like like I mean like for myself like I when I I mean like for myself like I when I I mean like for myself like I when I read a book or whatever like watch the read a book or whatever like watch the read a book or whatever like watch the movie I had like so many like ideas movie I had like so many like ideas movie I had like so many like ideas how it could be done differently or this how it could be done differently or this how it could be done differently or this could have happened, right? And this is could have happened, right? And this is could have happened, right? And this is like so nice that you can actually like so nice that you can actually like so nice that you can actually enable people to visualize these ideas. enable people to visualize these ideas. enable people to visualize these ideas. >> Yeah, it's uh going to be incredible. >> Yeah, it's uh going to be incredible. >> Yeah, it's uh going to be incredible. Continue success with it. You have an Continue success with it. You have an Continue success with it. You have an office in San Francisco. You're hiring office in San Francisco. You're hiring office in San Francisco. You're hiring people, yeah? people, yeah? people, yeah? >> We do, yeah. We just >> We do, yeah. We just >> We do, yeah. We just >> a bunch of money. >> a bunch of money. >> a bunch of money. >> We raised a bunch of money. Uh we just >> We raised a bunch of money. Uh we just >> We raised a bunch of money. Uh we just crossed 100 people. We're hiring in crossed 100 people. We're hiring in crossed 100 people. We're hiring in Germany and in San Francisco. Germany and in San Francisco. Germany and in San Francisco. >> Fantastic. Who are you looking for? >> Fantastic. Who are you looking for? >> Fantastic. Who are you looking for? What's the right type of person, the What's the right type of person, the What's the right type of person, the right type of skill? right type of skill? right type of skill? >> Yeah. Um >> Yeah. Um >> Yeah. Um on the one hand, we are always looking on the one hand, we are always looking on the one hand, we are always looking for for for researchers who have experience in researchers who have experience in researchers who have experience in large-scale model training, um large-scale model training, um large-scale model training, um experience in diffusion model training, experience in diffusion model training, experience in diffusion model training, flow matching training. We're looking flow matching training. We're looking flow matching training. We're looking for engineers who want to be working for engineers who want to be working for engineers who want to be working with the customers to, you know, develop with the customers to, you know, develop with the customers to, you know, develop these like customized these like customized these like customized um physically eye solutions or for um physically eye solutions or for um physically eye solutions or for example with like a IP owner like example with like a IP owner like example with like a IP owner like develop these models jointly with them. develop these models jointly with them. develop these models jointly with them. Um we're looking for engineers who have Um we're looking for engineers who have Um we're looking for engineers who have experience in just like large-scale experience in just like large-scale experience in just like large-scale compute infra, managing that, um and compute infra, managing that, um and compute infra, managing that, um and making sure that the training runs runs making sure that the training runs runs making sure that the training runs runs smoothly, that we maximize our MFU and smoothly, that we maximize our MFU and smoothly, that we maximize our MFU and all of that. Um and we're looking for all of that. Um and we're looking for all of that. Um and we're looking for people who have interest in people who have interest in people who have interest in you know, like uh getting the technology you know, like uh getting the technology you know, like uh getting the technology out there out there out there >> Yeah. In the hands of people. >> Yeah. In the hands of people. >> Yeah. In the hands of people. >> I the the the forward deployment of this >> I the the the forward deployment of this >> I the the the forward deployment of this there's just so many great ideas and so there's just so many great ideas and so there's just so many great ideas and so many great partners for you. I think many great partners for you. I think many great partners for you. I think you're going to with the open source you're going to with the open source you're going to with the open source specifically, you know, it seems like specifically, you know, it seems like specifically, you know, it seems like the corporates really want to have some the corporates really want to have some the corporates really want to have some additional level of control, but they additional level of control, but they additional level of control, but they also need the frontier models or your also need the frontier models or your also need the frontier models or your proprietary ones for some of those proprietary ones for some of those proprietary ones for some of those refined features. So, I think you have a refined features. So, I think you have a refined features. So, I think you have a very bright future ahead of you. very bright future ahead of you. very bright future ahead of you. >> and executive. >> and executive. >> and executive. >> All right, continued success. Thank you >> All right, continued success. Thank you >> All right, continued success. Thank you so much for doing the show. My pleasure. so much for doing the show. My pleasure. so much for doing the show. My pleasure. >> I'm going all in. >> [music] >> [music] >> I'm going all in.