New Technologies Always Scare Us. Is A.I. Any Different? | Freakonomics Radio | Episode 555

Key Takeaway

Treat AI output as a high-speed first draft, not a final decision. Today, choose one AI-assisted task—an email, summary, code snippet, or research note—and add a human verification step: check factual claims against primary sources, inspect for hidden tradeoffs, and decide whether the recommendation serves your actual goal. This small habit addresses the alignment problem now, while building judgment for a world where AI systems take on more open-ended work.

Episode Overview

Adam Davidson examines whether AI is simply the latest disruptive technology or fundamentally different because it may eventually perform a broad range of human tasks. Drawing on AI forecasting, labor-market history, and economic history, the episode argues that technology’s outcomes depend less on the technology itself than on how people choose to design, deploy, regulate, and share it.

Full Transcript

Transcript of New Technologies Always Scare Us. Is A.I. Any Different? | Freakonomics Radio | Episode 555 from Freakonomics Radio. Auto-generated from episode audio; may contain minor errors.

foreign ER Adam Davidson one of the founders of NPR's Planet Money podcast is guest hosting a few episodes for us they are about the past present and even the future of what's being called artificial intelligence a name by the way that practically no one working in AI seems to like the episode you're about to hear is part two in the three-part series that we are calling how to think about AI here's Adam when you dig into all the hype around AI all the terrifying fears and utopian hope it all comes down to one question when would it become affordable for a company to train an AI system as big as the human brain that is a Jaya kotra she's one of a growing number of people who are trying to answer this question will artificial intelligence ever be as powerful as the human brain and if so when will that happen that raises another question what happens if it reaches that threshold and keeps on growing should we be terrified thrilled should we hurry it along or should we try to put on the brakes human beings have been through massive technological Transformations before agriculture cities writing ocean-going ships the telegraph the internet is AI just one more new thing that freaks everyone out for a while and then we figure out how to live with it or is this time different thank you this is Freakonomics radio the podcast that explores the Hidden Side of Everything with guest host Adam Davidson Ajay kotra is a computer Scientist by training but her job is to develop ways of making measurable predictions I work at open philanthropy we work across a lot of different cause areas and at openfill for the last four years or so I've been specializing in AI forecasting and AI risk open philanthropy is mostly funded by Dustin Moskowitz one of the co-founders of Facebook and his wife Carrie tuna it has a broad set of goals one of which is to provide some clarity about what we can expect from AI if you type AI predictions into Google or YouTube You'll see a huge number of very amped up people telling you that AI is about to solve all of your problems and make us all rich and happy or that AI will kill us all in the last episode we learned that these hopes and fears are very much not about the current state of AI models like chat GPT and others are just big prediction machines they take in a huge amount of data every written word on the internet say and then respond to prompts from human beings by predicting which words that human is going to want to read next so whatever you ask it to do write an email to your boss or generate some software code it'll analyze billions of bits of data and spit out what the program predicts you want to see it's okay at doing that not amazing but okay I started calling it The B minus at everything program if you are well below B minus in something like turning a bunch of notes into a list of bullet points or coming up with titles for a paper chat GPT can probably do that better than you but if you're really good at something you'll mostly find the AI stuff subpar it's tempting to conclude all the fears of AI are overblown it's just not that powerful not yet anyway ajakotra agrees it's not there now if it were there we would know but I think that it could well get there very quickly because the way this technology works the way large language models and deep neural networks in general work is that if you train them on the same task with a larger data set and a bigger neural network and train it for longer than its performance predictably improves and what could that look like we're starting to see in at least some cases these systems have models of the world in their head so Othello GPT is this language model that was trained to play the game Othello which is a board game trained just on moves so it was given the move that player a makes and then the move the player B makes and then the move the player a makes and so on but when you crack it open and look inside it you actually find that even though it was just trained on text describing the moves and it was never seen in Othello board it has actually figured out a representation of the Othello board inside its brain because that turned out to be the most efficient way to make sense of this long list of moves back in 2019 so before the explosion of interest in AI due to chat GPT kotra and her team set out to determine where AI is headed to do that they developed a framework she calls biological anchors one thing that was hard about 4K forecasting any kind of measurement which is like this is how close the AI system is to doing all the jobs we had these little benchmarks that were like here's how it does on this kind of multiple choice test and here's how it does on simple summarization tasks and stuff and it was clear that just because you were really really good at those tasks didn't mean that you were going to obsolete humans so we needed something else to extrapolate and forecast basically and the thing that I landed on was how big is the AI system when would it become affordable for a company to train an AI system as big as the human brain at the time that I was doing this project the state-of-the-art AI system was gpt2 and according to our estimates of animal brain sizes gbt2 was roughly the size of a honey Breeze brain and it was already able to do some interesting stuff so that was a striking observation maybe if we got all the way to the level of a human's brain it could obsolete humans and by the way now I think gpt4 is roughly the size of a squirrel's brain last I checked there's a big debate right now about the very idea of comparing AI to the human brain is that even the right frame to use and kotra is the first to say she's doing some guesswork it's just a very rough tool brains and AI have some similar attributes they're both networks a network of nerve cells and synapses on the one hand a digital Network on the other you can estimate the number of nodes in the network the amount of data that goes through them and the speed at which they process it and so far it has been a helpful metric when gpt2 was out and it had a honeybee sized brain it was very basic it did not become a big viral hit you probably never heard a gpt2 I know I didn't but then when it reached squirrel level it started to amaze and terrify people okay let's run with this hypothesis that we might get really powerful AI systems that can automate most tasks once we're able to train AI systems as powerful as the human brain and then let's ask the question how powerful is the human brain and how much money and how much computation and how much data would it take to train systems that are as powerful as the human brain by looking at AI prediction in this way studying the number of nodes the speed of processing the size of memory kotra was able to come up with a simple reason why AI is not now at all equivalent to the human brain when she wrote her initial report in 2020 she concluded it was theoretically possible to build an AI model with roughly the capacity of a human brain but it would be expensive the amount of money it would have cost to train that system then was according to my estimates more money than existed in the world by a lot but computers are getting cheaper and the algorithms we're using to build these AI systems are getting more efficient her 2020 report called forecasting transformative AI using biological anchors has become a well-respected benchmark in 2020 she looked at the pace of growth of AI the cost of computing power and she concluded that there was a 50 chance that by 2050 we would have what she calls transformational AI meaning that artificial intelligence would be roughly comparable to human intelligence then came gpt4 and Google's Bard and anthropics Claude and she realized things were moving much faster than she had anticipated now my median is more like the late 2030s so that was a pretty big leap by median you mean it's as likely as not by that year kotra does want to make clear there is no reliable way to predict how AI will develop and the history of the field is filled with predictions that now seem absurd in 1965 the scholar and AI Pioneer Herbert Simon said that by 1985 a computer would be as capable as a human five years later another AI Pioneer Marvin Minsky was more ambitious he thought it could happen by 1973.

so it's best practice to Discount any specific prediction but it's still hard to ignore the question right now here's the first thing you might worry about if you're thinking about AI becoming as smart as you will it take your job will you get fired and replaced by a computer program there's a lot of anxiety about AI taking away jobs here's a report from Goldman Sachs issued in April predicting that two-thirds of jobs will be impacted by AI 300 million jobs around the world will either be lost altogether or diminished we can see this happening already the CEO of IBM said 30 percent of back office roles that's nearly 8 000 jobs could be replaced by Ai and the company Dropbox cut its Workforce by 16 citing advances in AI as the reason this is a familiar story some new technology comes along that can do something that previously had only been done by people and it's cheaper for employers to buy the machines than pay the people and now the people are out of work it's messy and painful there are very clear losers whose lives are permanently worse but less visibly and less immediately there are also usually winners who benefit in a way that nobody could have predicted economists have studied this issue obsessively how technology has immediate impacts and then an entirely different set of long-term impacts We examined in this work one of the largest automation events in modern history you that's the economist Dan Gross from Duke University we spoke with him last week about his work on creativity he and another Economist James feigenbaum wrote a paper about a technological innovation that had a huge impact on the workers of the 1920s the paper is called answering the call of automation how the labor market adjusted to the mechanization of telephone operation seen it in movies rooms filled with switchboard operators hello New York hello I have a new ticket I'm ready want it as soon as possible from London from London this is a job that once upon a time employed hundreds of thousands of primarily young women who sat at switchboards day in and day out connecting telephone calls it used to be a hundred years ago if you wanted to place a telephone call you picked up the handset and then somebody would come on the line and say number please and then you would tell them whom he wanted to reach and they would connect you by physically connecting an electrical circuit through the search board at which they said in 1920 operating a switchboard was one of the most common occupations for women in the U.S especially white american-born women under the age of 25.

it counted for roughly two percent of all female employment those jobs were eliminated because of a new technology invented by an Undertaker in Kansas city named almond Stroger the automatic switchboard a machine that could replace all those human operators he did it because the local switchboard operator was the wife of one of his funeral home competitors when people picked up the phone and asked for Stroger she would route the call to her husband instead and he'd swipe stroger's business Stroger patented his device in 1891 but it took until the late 1910s for automation to take hold it proceeds effectively one city at a time especially in midsize and smaller cities which only have one telephone exchange they get changed over to dial service effectively overnight it takes maybe a year two years to fully set up but literally the cables are cut over at midnight on a Saturday night the next day you have dial service you no longer need local telephone operators but the telephone operator job was not just the way a huge number of women made a living it was the basis of an entirely new way of life for some women it was not only lost the job but a loss of a community a loss of not just any job but of a fairly Dependable job a fairly interesting job at that I mean it was more interesting than factory work for example but let's step back from this problem for a minute and think about who's affected in their study gross and feigenbaum looked at two groups the first is the obvious one women who were working as telephone operators and then lost that job they wanted to see how that job loss impacted those women but there's another category too which is future generations of young women who are coming of age this was an entry-level job and employed primarily at the time as young as 16 year olds to 25 year olds and Not only was it a first job but it was a pathway into the labor force and so we think too about how future generations of women who are coming at working age now no longer have this opportunity in the labor market that could be a stepping stone into a career we want to think about both the incumbent operators who might have lost their jobs and the future Generations that have fewer opportunities in the labor market that they're facing as they graduate high school and these are two separate problems gross and feigenbaum weren't just looking at Big abstract data sets like percentage of employed women they wanted to see how this sudden transformation of a major industry impacted specific people over their working lives they use census and genealogy data and so we can actually start to trace people over time we can then say Okay a telephone operator in Dubuque Iowa in 1920 what was that woman doing in 1930 were they still employed in what industry and what job were they still working for the telephone company these are all things we can measure and here's what we learn first that the automation of telephone operation did have negative impacts on incumbent operators they were less likely to be working what's remarkable about this story is what happens to the Future Generations entering the labor market in the cities that have telephone service automated we don't find that they're less likely to be working afterwards we don't find that they have higher unemployment rates these are the younger women who never worked in telephones because they never they never had a chance to these are the kind of women who probably had a high likelihood to work in a telephone operation they're working they're not just sitting around unemployed it's kind of like we used to all be farmers now very few of us are farmers but we're not just all sitting around not farming we're doing other stuff and here we can unpack the story a little bit more too we can see okay what other jobs did these women take up and we see them moving into things like secretarial work we see them moving into things like waitressing work you see new parts of the economy finding uses for these young women and that's a version of this Dynamic feedback process through which the economy adjusts there's this phrase in economics that I find helpful the lump of Labor fallacy it's the idea that there are a specific number of jobs in the world and that if someone gets one of those jobs nobody else can have it or if one of those jobs is taken away someone will be unemployed it's not true it's a fallacy of course but it is a frame that a lot of people use it's one of the main arguments against immigration for example they'll take our jobs and it fuels a lot of the fears of any sort of automation including AI the reason it's a fallacy is that jobs are not some stable thing sitting in fixed lumps somewhere jobs are a dynamic output of the way the economy functions new immigrants might take one set of jobs but they use the money they make to get haircuts and buy food and higher tax accountants and so they create jobs too same with automation it might eliminate one type of work but then it often creates whole new kinds of work it's a compelling idea but it's pretty abstract what gross and feigenbaum did with their telephone operator study is show this process in concrete detail with names and dates the punchline basically is that the work didn't go away other work cropped up where old work was automated away and so in that sense we do see it as a silver lining paper perhaps a surprising Silver Lining how readily future Generations adapted and you know think too about what it was like to be alive at that time relative to today I mean there are just countless Technologies categories of work that exist today that were unimaginable then a couple of things to remember first there was real pain there were women who lost that telephone operator job and never found work that paid as much that's a real problem those people see their lives as permanently worse off and second more people benefited from the change than were hurt by it but they benefited in the future in 1920 when you're watching people lose work to machines and you don't know yet that some folks are going to be made better off it's easy to conclude this is a disaster this is just bad the big question what may be an existential question for us humans is a simple one is AI just another new tech that will get rid of a bunch of jobs but we or at least our kids will have all sorts of new cool jobs we can't even imagine today or is AI fundamentally different in the past technology took over specific human activities and opened up new human activities but what if AI is good at everything we do that's after the break I'm Adam Davidson and this is Freakonomics radio foreign of humanity is in many ways the history of technology and how that technology upends existing ways of living and creates entirely new ones here's someone who has thought a lot about these World Changers hi named Simon Johnson I'm a professor at MIT in the Sloan School of Management I teach economics and Global business to all kinds of different students you and I've known each other for a long time and the main way we know each other is talking about Banks and the financial system and financial crises I don't remember ever thinking of you as somebody who studied technology well I've worked on quite a few questions mostly related to long-term economic performance economic growth who becomes rich who stays poor and that work did lead me to the IMF in the early 2000s where I did get drawn into the questions of that time which were about financial crises and banking in particular but my interests have always been sort of beyond that in terms of how do some economies turn out to be so robustly prosperous and others really struggle to get there and in any story or analysis of economic growth technology uses in abusive technology is a central element Johnson co-wrote a book power and progress our thousand year struggle of over technology and prosperity with another MIT Economist Daron assamoglu the question that they address in that book is a big one why are some countries and some people rich and others poor it's a question that's fundamental to the discipline of Economics it's right there in the title of the founding text of the field Adam Smith's book an inquiry into the nature and causes of The Wealth of Nations a lot of the questions we have about AI today are essentially variations of this same question when things change why do some people win and others lose so yes we were interested in why some countries are so rich and why is so poor and we decide to look at the set of colonial experiences because well the Europeans did obviously after about 1500 was they expanded around the world they took control of lots of countries one way or another but what they did in those countries what they wanted to do and what they managed to do was actually quite different in different places it in places where the Europeans actually wanted to go and did go in person they set up certain kind of Institutions and actually that's the origin of modern United States as well as Canada Australia New Zealand some other places but in places where the Europeans didn't want to go for example because it was very unhealthy for Europeans to go there in 1600 or 1700 the Europeans found other ways to exploit the resources exploit the people they set up slave trade in some places they ran really extractive Societies in parts of Africa also Latin America also some parts of Asia variation within the colonial strategies enabled us to think about different Pathways that countries have been placed on by those Europeans by the colonial powers and then we were able to trace out the way in which income diverged across countries particularly when industrialization came so some countries were able to interest rise early let's destroy the United States for example others struggle to industrialize India would be a counter example of many parts of Africa are still at a very early stage with regard to industrialization so this is a big part of what's Driven the Divergence in income per capita around the world and why we haven't converged subsequently so that's all fascinating going back to you know the history of colonialism Etc but why does that make you interested in chat GPT which is like the opposite of History it's like the most Cutting Edge new technology economic history is about the history of how we've used technology and sometimes it's going really well and we've got a lot of benefits for many people and sometimes it's gone really badly so that technology has only benefited a few people it's actually pushed some people even into poverty sometimes the way which is used so for a long time many of us have been trying to think about what to do about that and now Along Comes a new technology which logically leads you to ask is this going to help us or is this going to further worsen the income inequalities and the answer that drawn I have is it depends which is the classic economic answer but it depends specifically on some choices we make about what technology we develop what versions We emphasize and how it gets deployed and how we think about what we want technology to achieve who's the we in that sentence I don't know anything about how to code a AI isn't that just something the engineers are figuring out our view is that engineering is too important to be left to the engineers if I could paraphrase president Clem also on that Georges clemenso the French prime minister during World War One reportedly said war is too important to be left to the generals World War one is an awful example of what happens when a tiny group of supposed experts makes a series of disastrous choices Johnson and assamoglu's book power and progress is filled with examples where decisions were made about how to take advantage of some technology or other and those decisions had unpredictable consequences for Generations some good some very bad Johnson hopes that we as a society can expand the group of people shaping how AI Works how it's designed I think we saw this for example the development of atomic weapons and nuclear power you need to have experts obviously they're the ones who invented the thing they're the ones who know how to prevent it from exploding but you don't really want to seed all the power to them or to the generals who are buying the atomic weapons and putting them in the country's Arsenal for example you want to have a lot of eyes on that you won't have a lot of civilians you want to have a lot of people who care about broader social outcomes and that's true of potential military aspects of Technology but it's also true when technology can affect jobs in a big way do you just tell the engineers stop inventing stuff so that we don't lose jobs that doesn't seem tenable like the engineers are going to engineer we are not saying that we're saying that there's been too much emphasis and overweighting if you like on this idea of machines and algorithms that could replace people foreign in the previous episode we talked to Lydia Chilton a computer scientist who is trying to teach AI to be funny and she told us she's not sure it'll work and she's also not sure that if it does work if AI can write funny jokes funny movie scripts if that would be a good thing for the world or a bad thing she's a computer scientist she sees her job as coming up with ideas to see if they work it's other people's job to figure out the implications of what happens if it works Simon Johnson has been talking with a lot of tech leaders about AI I asked him what they think about the impact that AI is likely to have on our lives what's our end game do they want AI to do everything that humans can do what I get is some fuzzy thinking and a little bit of a sort of fudging around that so this idea of surpassing human capabilities in some things or at least matching them that is an idea throughout the tech sector and that's a benchmark for achievement and I think that's the problem as opposed to saying I want to make people better at chess it's like I want my machine to beat the chess players when I try to think about the idea of progress I think about the history of my family I've studied the history of my mom's Jewish immigrant ancestors and my dad's New England Yankee ancestors in 1900 every one of my great great grandparents was poor very poor I shared some of my family records with a historian of Jewish immigration and she told me that my great-great-grandfather Solomon Davidson was the poorest Jewish immigrant she had ever seen my ancestors were farmers and Boot factory workers and rag Peddlers and sure enough over their lives and the lives of their offspring a series of technological advances have rendered all their ways of working no longer viable machines have taken their jobs is one way to put it but I feel okay that there isn't a job for me in the Boot factory that I am not a rag Peddler so I asked Simon won't this just be the same thing AI will hurt some of us there will be pain for a while but all of our great grandkids will be rich beyond our imagination well that is what technology can do and that's what technology should do Adam the tractor is a good story and the mechanization of agriculture in the United States that was absolutely accompanied by an increase in jobs in cities so people would leave the farm in the Upper Midwest go to Chicago work for McCormick's Reaper company making Reapers that were then sold to the farm so more people come to the city but when Stalin saw this from the perspective of running the Soviet Union in the late 20s early 1930s he wanted to do the same thing or one of the version of the same thing he actually oppressed the heck out of peasants including killing millions of people in Ukraine and other parts of the Russian Empire in order to generate the grain to buy tractors from the United States they use those tractors as an instrument of Oppression and collectivization so same tractors very different outcomes the railroad in the United States is a fantastic spread of opportunity and in the UK but the railroad in India was used by the British to move troops around and to get their cottonwoods into in Indian markets where they would destroy the livelihoods of indigenous people the Indians and the cotton gin and I mean the cotton gin is the most terrific of all so the cotton gin allowed the development and the commercial cultivation of Upland cotton for which there was increasing demand from British industry as industrialization grew but what that really meant was moving a lot of enslaved people from the East Coast where conditions were already pretty bad to the Deep South where conditions on the Cotton Plantation were much worse it was just a horrible horrible system made possible by the way the cotton gin interacted with the institutions of slavery and oppression of African-American people the point here is not that technology is bad it's also not that technology is good it's that the technology itself doesn't have some inevitable impact on human beings what can be good or bad is the way human beings create and share that technology and the rules the formal laws and institutions and and the informal assumptions and practices that we use around that technology there is a techno Optimus View and I find that I can be pretty sympathetic to it that history's main lesson is that technology on balance is more often good than bad Simon Johnson says that's a lazy read of History what do people creating technology deploying technology what exactly are they seeking to achieve if they're seeking to replace people then that's what they're going to be doing but if they're seeking to mate people individually more productive more creative enable them to design and carry out new tasks let's push the vision more in that direction and that's a naturally more inclusive version of the market economy and I think we will get better outcomes for more people oh and we can't take forever to have those conversations if we humans want to decide how AI will impact our world we better hurry well we're still the ones making decisions we could end up in a situation where you need to rely on and defer to AI decision makers if you want to be competitive at all on the world stage that's after the break I'm Adam Davidson and this is Freakonomics radio foreign The Economist Simon Johnson brought up a question that we should be asking about people who are developing AI systems what are they trying to achieve and is it something that will be good for the world but there's another issue that people in AI are raising that goes further than that they call it the alignment problem the high level description of the alignment problem is that surprising as this may sound I don't think that we have at a technical level found a way to guarantee that if you're trying to train an AI system to pursue some goal for you that it will actually learn to pursue that goal as opposed to pursue a different goal including a goal that might put it in conflict with you that's ajaya kotra again from open philanthropy whom we heard from at the start of the episode These AI systems like open ai's gpt4 are trained to do something when they are designed and as they are developed the human beings who create them have some explicit goal in mind it could be a simple one get better at distinguishing dogs from cats or it could be a far broader one given whatever prompt a human being types in come up with the best prediction of what the human wants to see next so there is an overall goal for the system and then there is the specific task like write me an essay about the history of frankfurters or whatever the reason gpt4 is so powerful is that each choice it makes each of the words it lays out in say an essay about hot dogs is based on hundreds of billions of factors that means you can never know why it's doing what it's doing why when I asked it to write me an essay about the history of frankfurters it typed this sentence some argue that the Frankfurter was created in the 13th century for a royal coronation if I wanted to figure out why it picked those exact words I would have to look at chat gpt's estimated more than one trillion parameters for each word now as it happens it's totally made up nobody anywhere seems to have ever argued that the Frankfurter was created in the 13th century for a royal coronation so why did chat GPT make that up it is literally impossible for human beings to figure that out now an essay about hot dogs is not that big a deal but kotra says this kind of mistake where it confidently tells us something wrong and we don't know why is a perfect example of the alignment problem the alignment refers to the alignment between your goals like what you want the AI system to be doing which is you know write better code in a certain way and don't do anything bad and what the AI system is actually pursuing let's say usdi to help you build a website and that website seemed to be running great the thing is AI might help that website run more efficiently by for instance compromising the site's security features but that's kind of hard to notice then it may get rewarded for using that shortcut because you run the code and you realize oh wow my website loads much faster that's great you know thumbs up but you didn't notice that this came at the cost of inserting some sort of security vulnerability I I've always heard of the alignment problem in the context of will Killer Robots kill us all but it sounds like from what you're saying that's just a small subset I mean potentially an important subset but the alignment problem could also be like does my tax software actually find the right tax breaks for me or does my driverless car actually find the most efficient way home or whatever it could be a more trivial problem right now we have misaligned AIS and we're all still here Bing Sydney is a great example right you may have heard the story of New York Times Reporter Kevin Roos who had a bizarre conversation with a GPT powered chat tool built into Microsoft's Bing search engine the chatbot which identified itself as Sydney told Roose to leave his wife and describe dark fantasies of hacking computers kotra points out Microsoft had explicitly trained the chatbot not to do things like that Microsoft didn't want its AI system to try threatened users and create this big PR Scandal for them they tried to train it not to do that but they didn't succeed at making sure that it actually never did these harmful actions even though in some sense Sydney or Bing could be said to have the understanding to know that Its Behavior would be upsetting to humans it didn't actually follow through on its understanding the very last thing Microsoft would have wanted is for a reporter to have an unsettling encounter with its chatbot just as it's trying to take over the ai-powered chatbot industry it had very smart people highly trained experts telling the chatbot what they wanted it to do and still it went rogue you may also have heard the case of Stephen A Schwartz a lawyer who had chat GPT Write a brief which he submitted to court and only then found out it was filled with made-up information including fictitious legal precedence and you've probably heard of stories closer to home I know several teachers who see students suddenly turn in papers far more detailed than they ever had before we are all learning some of us more painfully than others that the output of AI is not ready for prime time it needs to go through a human Editor to make sure it's not wrong or disturbing but kotra says that it's very likely that as AI gets more capable the best way to take advantage of its ability to assess huge amounts of information will be to let it make decisions that human beings won't be able to evaluate AI can already process more data points and look at those data points in far more ways than a human can when you stack up all those advantages along with their raw capabilities we could end up in a situation where you kind of need to rely on and defer to AI decision makers if you want to be competitive at all on the world stage whether that's economically competitive or militarily competitive so it's not only the case that you can have ai CEOs of companies alongside human CEOs of companies it's that when you get to the point of being able to have ai CEOs at all you quickly blow past that to the point where human CEO those are not viable so if you're the shareholder of a company you're really just not going to make any money unless you appoint an AI as CEO and if you are a country you're not necessarily going to be competitive in a war unless you have ai generals and you have ai soldiers executing those AI generals orders with more precision and speed than human soldiers ever could it's kind of a world where like right now I think you can't really get anything done if you refuse to write or even if you refuse to use a computer and I'm imagining a future where you're just kind of irrelevant if you refuse to lean on AI decision makers in all spheres of life my emotional reaction to a world in which AI generals are fighting other AI generals and AI CEOs are competing with other AI CEOs that feels like a worse world to me that feels like a pretty bad world and the way you described it there seemed to be an assumption that they are pursuing aims that human beings recognize as good aims but I have to assume they would then have their own goals like why would they have human goals if they're running the show wouldn't they have their own goals so people have a really wide range of reactions to this question from why at all would they have human goals to like why would you think they have their own goals even if they're running the show that's not how they work and I think it's just pretty wide open I think it's possible that we could end up with these systems that are in fact considerably more powerful and thinking faster than us and making all the big decisions while still at a high level pursuing the goals that their users have given to them which by the way is not necessarily mean we're obviously in a good State you know some of these users might be giving bad goals to these AI systems I'm trying to understand the path what are the steps between where we are now and it doing most activities one thing that seems plausible to me is that we will see a kind of transition from some more closed-ended contained short tasks to more open-ended tasks I imagine we'll see a gradual moving from being able to write little functions to something more like where it tries stuff and then it might not work but it knows how to like read the error message and try again so we would be seeing a series of steps right like each year you would be able to kind of check in and say are we closer are we further away than I thought we'd be at this point I think you will see some kind of gradual increase in usefulness but I wouldn't really Peg it to each year actually I think I would Peg it to each GPT if we as humans as a society make a jump from gpt4 to a model 100 times bigger than gpt4 the next year just by choosing to spend a huge amount of money on it then I don't think there are any guarantees that the progress we see on the outside is going to look gradual because you might just like Zoom through all the different levels of capability by going from GPT 4 to 100x gpt4 in one shot maybe this is just like anxiety management inside of me I'm hoping that we're going to have a bunch of steps along the way I'm hoping so too yeah where we can kind of say oh that that was a little more than we wanted but let's get to what do we do about it I think one thing that is a blessing and a curse about how this technology works is that it is really driven by the size and computational power of these AI systems themselves so the thing that was different between gpt2 and gpt3 was mainly that gpt3 was a lot bigger than gpt2 and as a result it was a lot more expensive to train and that's why it was able to do all these cool things that gpt2 couldn't do and that's why gpt4 was able to do all these cool things that gpd3 couldn't do this idea that AI doesn't grow in a steady way but rather has these huge leaps forward means that an AI with entirely new capabilities can suddenly appear in our lives without us being prepared and as the AI systems get better they are even more difficult for us to understand now the AI companies and the computer science researchers have a clear goal they want to get the next great thing before others do AI has become a major focus of venture capitalists who put more than 40 billion dollars into AI companies in the first six months of this year alone gpt4 cost much less than one billion dollars to develop I think that means that as a society if we want things to go more gradually it makes sense to pay attention to the steps we're taking in how powerful these models are and I think it could make sense to require and regulation eventually if your current model has certain kinds of concerning capabilities that we can try to Define ahead of time and try to measure well then you need to register with the government the next model that you're training and it can't be too much bigger because if you go too much bigger then who knows how much more capable it'll get and you need to get some kind of approval that making this step is okay and that you as a company can handle it so there would be like the agency of AI alignment or something like that but the US despite our best intentions is not the entire world and this is what everyone inevitably says well maybe China will then take the lead maybe North Korea or other Bad actors will take the lead walk me through your thinking there how do we make government regulation that's effective I more often spend my time thinking about technical level what what look like if we could somehow get people on board with it one thing that seems like a success story on an international stage is nuclear non-proliferation I don't think it's a complete success story but I think relative to what I might have expected in 1945.

I think I would have been kind of surprised that we're still here and not literally every single country has nukes even though more countries have nukes than they did in 1945. so that's maybe a model we could look to for hope we started this episode with a fairly simple question one on all of our minds will AI take your job and it seems clear with regards to any one specific job it's pretty hard to say but we can definitely know that when it comes to jobs in general AI is going to have a massive disruptive impact like a lot of people now and throughout history I look at this new technology and one of my big feelings is fear but that's not the only way to think about it I think that it helps to have a utopian Vision here next week on the third and final episode of our series how to think about AI should we really have a utopian Vision about AI what does a world where AI is everywhere even look like how will it change your life and how might you have to change that's coming up next week on Freakonomics radio I'm Adam Davidson thanks for listening and I am Stephen Dubner thanks to Adam for the guest hosting we would love to hear what you think about this AI Series so far our email is Radio at freakonomics.com and remember next week Adam will be back with a third and final episode in this series until then take care of yourself and if you can someone else to Freakonomics radio is produced by Stitcher and renbud radio you can find our entire archive on any podcast app or at freakonomics.com where we also publish transcripts and show notes this series was produced by Julie canfer and mixed by Eleanor Osborne Greg Ripon Jasmine Klinger and Jeremy Johnston we also had help this week from Daniel Moritz rapson our staff also includes Alina Coleman Daria Clement Elsa Hernandez Gabriel Roth lyric bowditch Morgan Levy Neil Carruth Rebecca Lee Douglas Ryan Kelly Sarah Lilly and Zach Lapinski our theme song is Mr Fortune by The Hitchhikers the rest of our music is composed by Luis Guerra as always thank you for listening you've been on my calendar for a while and I had in my head like oh AJ is going to calm me down not that it's your job it's maybe the opposite of my job it's radio network the Hidden Side of Everything Stitcher