How Does AI Impact Education? – Wharton Professor Ethan Mollick | AI in Focus Series
Ask about Knowledge at Wharton
Episode Description
EPISODE OVERVIEW Wharton professor Ethan Mollick joins Eric Bradlow, vice dean of Analytics at Wharton, to discuss AI’s impact on education: How is generative AI being used by students? Should teachers embrace AI in the classroom? Their conversation touches on the latest developments in ChatGPT and other generative AI tools, and how they will affect educators and the workforce at large. This interview is part of a special 10-part series called "AI in Focus."
Topics and questions covered: 00:00 - Introductions 00:40 - Understanding AI's role in education 4:10 - Democratizing education with AI 7:28 - How is homework impacted by AI? 10:50 - Exploring AI's capability to hear 12:29 - Prof. Mollick's research on AI 16:18 - Do corporations doubt AI's potential? 19:22 - AI regulation in the U.S. 22:49 - How to practice using AI 25:59 - Potential frontiers of AI
SERIES OVERVIEW The artificial intelligence revolution is officially upon us. Hear from host Eric Bradlow, Vice Dean of Analytics at Wharton, as he meets with Wharton faculty experts across a wide range of business domains – from healthcare and neuroscience to sports and the auto industry – to learn how AI will impact these fields moving forward, and what we can do to stay ahead of the curve.
----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.
Launched in 1999, Knowledge at Wharton offers free access to:
- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox
Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU 📂 Analytics;Technology;AI 🏷️ Research;AI in Focus
Read the full transcriptHide the full transcript
- welcome welcome to this edition of the AI at Wharton and analytics at Wharton podcast series on artificial
- intelligence today's episode will actually have a dual role while it says Ai and education here our guest actually
- has lots of expertise in Ai and education and the workforce and a lot more General topics as well I'm joined
- by my faculty colleague uh Ethan mik Ethan is the Ralph J Roberts distinguished faculty scholar he's an
- associate professor in our Management Department he's also the academic director of Wharton interactive so Ethan
- Welcome to our podcast series I'm thrilled to be here thank you well I don't even know where to start because
- I'll just say and I this is my first question to you most of what I've learned on AI and education will start
- there is by watching the five-part series that you and your wife created um so could you tell our listeners here on
- our Ai and education and Workforce uh episode what was in those five episodes like what do all of us as professors
- need to know about Ai and education well I mean there's at least three different
- things that matter right the first thing that matters is disruption uh homework is over right there's not a homework
- assignment basically anywhere that a well- prompted AI can solve at this point so that's a big deal and just to
- be clear let me take them one at a time there are explain to our listeners there
- are multiple versions of even let's even say chat GPT which is just one of the open AI sources like some versions can
- ingest documents some versions cannot some have just a text prompt so which version or versions are you referring to
- when you say kind of home homework as we know it is over okay so when you think about AI you want to think about um sort
- of all the what's called Foundation models which are llama and Chachi all these kind of different models but you
- also want to think about what are called Frontier models not to create more confusing vocabulary but there's really
- only three Frontier models right now which are open AI chat gp4 uh which is the paid version but you can also get it
- for free through Microsoft Bing in creative mode which turns out to be really important for education for
- reasons we'll talk about which is the way I do right now and it's a little Limited in some ways it's weird it's has
- a personality we can talk about that then there is um Google's Bard which right now is powered by a underpowered
- model called pal 2 but all the rumors are that it will be upgraded to a model that probably will be the first model to
- beat gp4 in the next couple of months and then finally there's a company called anthropic that has a product
- called Claude 2 so when we talk when I talk about AI can do something I'm almost always talking about the frontier
- models so gp4 um currently has like a separate mode for vision and pictures that's all
- being united there's already been they're already rolling that out so they'll be able to take in documents
- take in images read PDFs it already can it just does it a little bit uh jenily right now well let me ask you a few
- things um well all of this right now there are paid and unpaid versions what's your vision since you also teach
- Innovation you teach entrepreneurship are all these things going to stay free if they are what's
- their revenue model is it adverti like how do you see this playing out from just a from our point of view and from
- the company point of view so right now open aai is has announced that they're on a run rate of $1.2 billion in revenue
- for after less than a year after releasing chat GPT most of that money probably comes through their use of
- their API which is their their um businessto Business Solution right uh less of it is the $20 a month we pay
- right if you pay for gbd plus which by the way if you can you should um there's is almost the difference between gbd4
- and gbt 3.5 the paid version and the free version is so large as it may not appear that way at first but it's big
- enough that it is 100% worth it um Microsoft releases a bunch of gp4 products through Bing and they're
- planning on doing it free as far as I know for the near future Google bard is also releasing theirs for free both
- because it's part of the search engine fight going on so we are the benefits but it also means that people in 169
- countries around the world have access to gp4 and will probably have barred access as well which means the same
- model that you get access to if you go to Goldman Sachs or you go to you know McKenzie or you go to Nike it's no
- better than the model that every kid in ug Gand and Sri Lanka has access to which I think is really exciting and
- interesting also really a big deal for Education well you've brought me five questions but let me go one at a time so
- I'm getting excited here um obviously you spent time thinking about Wharton interactive so this idea of
- democratizing Education through something like this has to be really thrilling and exciting to you as an
- educator and a scholar because I know that was part of your mission and still is with Wharton interactive yeah so for
- those who don't know Wharton interactive is our attempt to build games and simulations to teach entrepreneurship at
- scale and Wharton's been incredibly supportive we have you've been incredibly supportive we had we've have
- built these very large games we have a team of people we have writers and coders and you know interactive fiction
- experts and you know once gbd4 came out we just tried the little experiment we tried saying like what if we just write
- a paragraph create a simulation of a negotiation give me grading on it make it realistic and 80% of the way there
- with a paragraph like gbd4 just runs a simulation so we have pivoted now all of our simulations are basically AIS
- powering every we have ai watching ing Ai and AIS that are instructors and AIS that are mentors all interacting with
- each other that are actually doing teaching right so so is it writing the code doesn't it doesn't even need to
- write the code like it is writing the code but that turns out to be secondary it's writing the code it's creating the
- images it's doing all that stuff but what it really is is also the brain's the operation if we do good prompting we
- can tell it here's your goal make sure that you're keeping students engaged change Tone If you need to here's your
- overall and it just does it all I'm just in shock because wow so let me ask you a
- question how does one become I know this is part of your video series how does one be I don't know if called an expert
- but how does one become sophisticated is a good word in prompt engineering like could I do this be do I need subject
- matter expertise to create specific enough prompts or is it just by as you and your wife talked about in the video
- series you'll just learn by doing yeah so it's a really good question and sort of all of the above so a few things one
- is for those who don't know prompt engineering right is the idea of writing really good prompts to AI it is going to
- go away uh there's not a I talk to open AI regularly talk to Microsoft talk to Google nobody who's insiders thinks this
- going to last because the AI is really good at intent if you say I want to write a novel fairly soon it'll just be
- able to say like okay here's let's go through the steps together it already kind of does that right so it's you can
- get 80% of the way there by just interacting with the AI now there is an exception if you want to encode your
- expertise as a subject maner expert you want this to do a really good you know marketing analysis it will do a
- perfectly fine job but if you en code your expertise into it by saying here's the angle you should take here's the
- approach do a little bit of prompt engineering you could give that prompt to anyone and they'll get the benefits
- almost of your experience or wisdom so there is some value in doing that uh it's pretty straightforward most of it's
- using it 10 hours of the frontier model is my minimum rule of thumb but then beyond that piece there's a couple
- simple tricks so one is you tell the AI who it is you give it context so the more context the better you are an
- expert marketer and weirdly by the way there is a research now suggesting that when you tell the AI is an expert under
- some circumstances it works better um again it's there's a lot of strange stuff about prompting the second thing
- you want to do is provide a lot it's called fuse shot you want to provide a lot of examples so when you're sending
- that you want to say here's some examples of the kind of report that you'll produce and the third thing you
- want to do is have it do step-by-step thinking so you want to say first do this then do that then do this because
- it kind of only knows what it writes so you want to write stuff out and then go back to it and then build a plan from
- there those three things will make you a better prompt engineer but it's not going to be that important in the long
- term all right so let's go back to the focus of AI and education so let's talk about the roles that we have as
- Educators you already said the traditional way of doing homework let's start with homework is in Jeopardy so
- given that what can we do or in my view I've already I'm teaching next semester I'm like use chat GPT as a matter of
- fact if you know how to do this to solve the problems I'm asking you to do that's
- a skill set or should I be thinking about this differently then I want to go to standing in the classroom then I want
- to go to other forms of assessment and things that we do yeah well so the problem is what I feel is everybody's
- rushing to do a chat GPD class right and then the answer is like yes chat can do
- that I mean there are very few things that um at a sort of medium level that chat like at the 80th percentile that
- chat doesn't do reasonably well right now so the question is do we want all of our classes to be can you use chat CP to
- solve this problem I think we still want to teach the subjects that are really good at teaching we still think people
- need to learn these things which means we have to adjust right uh you can't use by the way everybody should know do not
- use any kind of um AI detector they do not work they're biased against people use English and second language they all
- whole five you know that that ship is sailed we cannot detect AI okay so just to be clear just like when we we have
- canvas at the University of Pennsylvania there's a turn it in which is so whatever version of that for AI you
- might as well just forget it no it doesn't mean but well this isn't look I think you can see where my next question
- is going let's say Eric bradow and Ethan mik are both in a class and they both use chat GPT for to solve some problem
- and let's say by chance they happen to both put in the same prompt will they get the same exact text back and if the
- answer is no if both of those were turned in could canvases turn it in not say it was AI generated but would it say
- hey wait a second there's cheating going on there because their responses are so
- similar so really good question a few things first of all they wouldn't get the same answer because there's
- Randomness built into this a temperature right so there's a r there's a random seed initially and then the words are a
- little bit randomly different which IES over time you're saying large language models are prob I'm a statistician are
- are they're probabilistic models which means even if we put in the exact same prompt we're going to get out things
- because there's a probability of the next word or the next phrase and they're autoaggressive so once they head into
- one direction or another they sort of spin off in that direction further very interesting so that's the first thing
- right the second so the the second thing is I have had an assignment even before
- chat GPD came out using gpt3 where I had my students cheat in class so I had them
- write the best essay they could part part of the assignment is you have to prompt it at least five times by the
- time youve prompted AI two or three or four times there's no way that they seem similar anymore right if you give it so
- yes if people just pasted in the question right they're not going to be the same answer but they might have some
- similarities if they do any work like make this more Vivid or here's my writing style that's all they need to
- make it very different turn in will not detect those things and by the way I really think it's unethical to use turn
- in right now you should be turning it off right like it is it is it it will falsely has a high f accusation rate and
- also by the way even worse is to ask GPD 4 or chat GPD free the 3.5 free version
- whether cly was created by AI um new studies showed GPD 4 has a 95% rate of just telling you that something's made
- by AI if you paste it in and ask if it's made by Ai and GPD 3.5 has like a 5% rate of telling you they just randomly
- say this is made by AI or not they have no way of telling so what kind of things
- can be you know what when you presented to the Wharton faculty which was one of the best most informative presentations
- I've seen the a long time when you presented to the Wharton faculty I was like okay maybe at the time this was
- true like all right so maybe it's not text data but maybe I'll give exam questions that have video or maybe I'll
- give stuff that has voice because you know what chat GPT can't possibly do as well with that am I off base or well let
- me just say I might be correct but it's better than you think no it's it's better at voice than humans are right
- now so whisper which is the free uh G built in the chat GPT app uh probably illegally trained not illegally I don't
- I don't know who's watching but trained on uh on YouTube videos probably as far as we can tell has better than human
- hearing so like accents um you know mixes of languages I use it all the time when actually my students pitch to it um
- I have real venture capitalist and then I have the AI playing a VC the VCS think
- that the AI does a better job than they do in giving feedback um so yes it can listen um they and now can see things so
- any visual problem you just upload and it will address a video or anything so video still has a little bit of trouble
- with so that you can just pull off video right now um but give it give it give it
- a few days no I mean a couple months probably well you actually wrote up another topic and we'll we've been
- talking about Ai and education again I'm joined by my friend and colleague Ethan
- mik he's the Ralph J Roberts distinguished faculty scholar a professor in our Management Department
- also the academic director of Wharton interactive and clearly I think it's fair to say one of the leading Scholars
- on artificial intelligence both in education and the workforce um could you talk to us about the work that you've
- done on AI and the workforce cuz I know you're extremely proud of the work you're doing and I just want to see
- because a lot of our you know uh experts have talked about it's can't be AI or humans it's got to be Ai and humans I'm
- just interested in the angle in which you've studied AI in the workforce yeah s okay so um one example we have a I
- have a paper with um a whole bunch of great people at Harvard including kareim Lani uh frbo dequa um and people at MIT
- Kate Kate Kellogg a whole bunch of people on this project but what we did was we went to BCG right one of the
- three big Elite Consulting companies um and a lot of our Boston Consulting Group
- a lot of our students want of work there a lot of alumni work there and we did an
- experiment we uh created 20 tasks they were all realistic tasks with BCG they're actual tasks they use uh and we
- gave some eight we used 8% of the global Workforce which is a lot and Al So when
- you say an experiment you mean an actual experiment I mean an actual experiment 8% of their Global Workforce and some of
- them got the help of gbt 4 and some did not and there were a bunch of other conditions the people who were given GPT
- 40 use in business house had a 40% Improvement in quality no training no specialization in the mod just the same
- chat GPT all of us have access to 40% increase in quality across 108 regressions how was quality measured
- every way we could so we did okay analytical tasks and marketing task and persuasion T and all of them were graded
- by human phds human NBAs and then we also used gp4 which by the way grades just as well as humans do it just is a
- little nicer on the scores but the relative scores were exactly the same and then they completed tasks 26% faster
- got 12 point Sorry 26% more tasks done 12.5% faster no training nothing training like we only had like 5 minutes
- of training for sub conditions others for none just to put that in context when steam power was put into a factory
- in the early 1800s and improved performance by 18 to 22% we've never seen a 40% Improvement this is not tuned
- this is not train this is the chat interface that you're used to using um so huge huge performance impacts on on
- from just a little experiment all right so usually in academic papers we have some thesis hypothesis and in your case
- you have an experiment in results what did the back end of that paper look like so let's imagine you're now Consulting
- for a company BCG or you're Consulting to our students undergrads mbas like this should be how you think about your
- training what did the back end of the paper like what conclusions did you come to as a result of this well we barely
- there's so much else we could talk about here too that are you know interesting caveats on creativity and who who uses
- what answers but let let's and and also how people people work with AI right that's another thing I've been doing a
- lot of work on uh effectively but um I mean the back end of the paper is really the idea that like look this is a big
- enough impact that this should be a red alert everywhere in every organization right you don't see these kind of
- performance improvements a lot of people are taking their time on AI they're assisting that they do something like
- you know integrate their own data with the AI system we didn't have to do that here like the AI the p and GPT stands
- for pre-trained it knows a lot of stuff already it's not clear that you should be waiting to build a large data
- integration use r and all these other techniques when you should just probably be using this and it should be a red
- alert to figure out how to use this because you know as much as we say oh it's people using AI but also I mean
- another side of this paper was there's appendix C to the paper that I don't always talk about because it's I don't
- quite know what to do with it but it measures uh what's called retainment how much of gp4 is answer that you just use
- as your answer and there's almost a direct correlation between how much of the answer you use and how successful
- your results are I mean there's a direct correlation it's almost perfect correlation so basically the only way to
- mess up was to changed chat gpt's answer H and not only that the performance boost was at the largest for everyone in
- the bottom half of performance so we measured prior and after performance 42% boost and improvement from the bottom
- half 18% for the top half performance it leveled everybody up to like the 8th percentile of BCG Consultants like I
- don't even know what to do with that that's such a big number so given as you said this is more impactful than the
- steam engine what what did BCG now do with this like what's their planned I mean is there any let me just say Do
- they have any doubt that what you found is generalizable like maybe here's an argument I'll be a statistician for a
- moment maybe this wasn't Al you said 8% of the workforce maybe this wasn't a massive sample size maybe it works for
- these 20 tasks but not for these tasks or maybe there's some sort of you know maybe it helps in the short run but you
- know what we can also train humans so maybe the effectiveness is going to decrease over time I'm just playing a
- like if I were a reviewer on a paper I'm just playing The Devil's Advocate what would be the respon to all of this so a
- few things there we did manage to create one task the AI couldn't do and right so
- one of the things to know about our listeners here how want to hear what that is so well it was hard right it was
- a task where we had to hide data in interviews and some was in spreadsheets and this was before Ada the Advanced
- Data analysis module came out but we managed to find something right um and it took some work and then on that task
- you what happened was people who used AI did worse because they were mistaken because they took in what they was do so
- there so part of what people are saying is like well what's the border of what AI does and doesn't we call that the
- jagged Frontier like for example if you ask gbd4 to write a 25-word paragraph it'll have trouble doing that because it
- doesn't see words it sees tokens but if you ask it to write a sonnet it'll do an
- amazing job of that sonnets are harder for humans than 25 words you have to learn the frontiers of AI going back to
- the point we mentioned earlier if you use it a lot that's how you start to understand it's going to be good at this
- task bad another task so to go back to the overall kind of question right about what do you do with this right is it
- generalizable this is just one piece of result there's another study out MIT that got published in science that shows
- similar size improvements in business writing tasks in a completely different sample there's a study um out of GitHub
- showing the same kind of improvement for programmers like the 30 to 70% number just keeps coming up over and over again
- in different samples and different there's a piece on Creative work there's another paper U out of Harvard looking
- at um at you know business implications uh sorry business um proposal writing there's our own colleague Christian turt
- Carl erck and and their colleagues work showing Innovation so this is not like a
- onetime thing you know this is a pretty broad-based set of findings so where do you think the I I like the word Jagged
- Edge yeah where is Jagged Frontier where is the jagged Frontier here I mean do you even I mean you probably know more
- than let's say you're in the one 1000 upper percentile of people in knowledge about GPT or AI in general right now
- where do you think that Jagged Frontier is so it's hard to explain right which is part of why this is as much doesn't
- it always move out that is that's the main thing is the frer is moving out like I guarantee in the next month the
- frontier is going to move out right like some for some reasons I know I can't talk about some reasons that are already
- public elsewhere but like this is not stopping there's no indication to me that the jagged Frontier is not going to
- keep moving forward in the next few months right next year or two and I think ultimately the big question is how
- far how fast and when does it stop and I will tell you the people training the AI
- models I don't think have an answer to that question so let's start with a few things um how much I I saw I think it
- was yesterday President Biden sign signed a bill or something an executive order on artificial intelligence and
- some sort of safety security protection could you tell our listeners what is that about like what is what is the
- policy trying to do so there there's a few things in the policy right what I I I I have not spent a huge amount of time
- in the executive order but what it does that I like about is there's there's sort of two stages of threats from AI
- that people are worried about one is you may have hear if you read the press a lot you may hear about Extinction risk
- right what if we make AGI artificial intelligence smarter than a human and what does it do to us does it save us
- does it kill us what happens if we build a machine God and by the way that's like
- the stated goal of open a AI is to build AGI right that's their plan by the way just so I know I I just want to be sure
- since I'm a big movie guy I don't know how much you watch movies like wasn't that some part of Terminator like in
- other words these robots became so smart that in some sense they ended up launching Wars and I mean the
- schwarzeneger movie ter that is it's not unrelated right no that that is one example of AGI right um the people who
- are in favor of AGI think that this will save us all and you know and redeem humanity and give us all eternal life
- the people who uh don't like it think it'll murder us all so I think it's worth worrying about like it's something
- that enough serious people in computer science are worried about that we should I'm glad that we're addressing that but
- I think the bigger policy implications in the near term for me as somebody at the Wharton School is look we've got
- something that's doing high-end creative work high-end managerial work it's going
- to get better at this like we're improvising a chat interface and using that to do Consulting work like that's
- pretty crazy so that means there's going to be widespread implications for work widespread implications for Education as
- we've were talking about and also one of the things that really is important like
- the part of the reason we catch criminals and like Bad actors so easily especially when they're not connected to
- like a state intelligence agency is most of them aren't that great right now what
- happens if the AI makes brings everybody up to 80th percentile in biological engineering 80th percentile in building
- chemical weapons that's also a concern and then there's privacy concerns deep fakes are perfect from this thing right
- like so can you define what a deep fake is like what does that term mean sure I mean AI um content is basically
- undetectable I have made videos of my fake me talking I I my presentations I always have one real picture everything
- else I generate on my own no one could tell what the real picture is right so you cannot tell if I can create an actor
- with their voice I can do this right now for $150 with software that anyone can use it's not even like dark web software
- it's a company that's VC backed uh and I can use 11 labs in did and create a fake
- video of you talking right now and you know it'd be pretty realistic so we have this issue with this kind of deep fake
- email it's also perfect fishing engine like you shouldn't trust anything you see online anymore and that's not a joke
- like there literally is no way to know like I've already talked to Banks who've gotten calls uh in from the voice of
- people who weren't actually calling them demanding money from ransoms like stuff
- is going crazy already that is ship is already staled so part of the Biden agenda is like how do we Watermark these
- things not going to be possible like it's just that's that's not going to happen really because even though these
- Frontier models are based in the US there's a whole bunch of Open Source models worldwide models that are not
- going to have this kind of protection so the the the attempt of this executive order for the way I see it is both to do
- worrying about this sort of future Ai and training it but also trying to think about how do we restore privacy how do
- we restore you know and I don't know how much of that's possible but the regulation is probably needed so a lot
- of our listeners are probably sitting here saying I need to get started like I I I haven't even started but now clearly
- if I'm listening to Professor mik I've got to start now where do you suggest that someone starts like you mentioned
- 10 hours let's say that's good what what should they spend their 10 hours doing like where should they go you know we're
- at Wharton so we're fortunate we have the video series you sent around but I mean whether it's you have materials
- others have materials can you go I'm making it up can you go to KH Academy I I don't know where did where does
- someone go to get started so a few things those videos are on YouTube anyone can see them if you search the
- name of ethol you'll find it I also have a substack with a whole bunch of getting
- started guides called one useful thing all which I just which I just started following today excellent hopefully
- you'll enjoy that but I mean I think the B BS of this are my my principles of AI
- my first principle of using AI is just invited to everything you morally and legally can use it for everything use it
- for your job like literally you want to send an email see how good the AI is writing the email you have to do
- ideation you know have it do ideation you going into a meeting bring it to the meeting have it record the meeting and
- give you advice and feedback on what you should do better next time just use it for everything that's the only way to
- figure out what the jagged Frontier is in your field there nobody knows anything right now right like as I said
- I talk to all of the major AI companies on a regular basis and like no one has an instruction manual for this thing no
- one knows whether it's going to be good or bad in your subfield whoever you're listening at right now so you can be the
- world expert by just using it and seeing what that is so just try it for your work and then there's a bunch of
- techniques you'll start to learn but the first thing is to try it it's really important though to use a Frontier Model
- to use the most advanced model available to you right now now you mentioned something else about you think that I
- think let me see if I got this right that I think it was Google you I think you use the term like they're coming out
- with something new that might be better than chat GPT what would better mean in like when you use the word better I was
- just intrigued by that what does it mean to be better than one you know uh large
- language model Etc being better than another okay so there's a lot of interesting angles to that right now all
- the major front the two major Frontier models which are open ai's model which sort of Microsoft Powers it as well and
- Google's model both are have added a whole bunch of capabilities that if you're not paying attention you may have
- missed so they're all fully multimodal you can ask them to create pictures they they also can see the world right so
- like not doing an image search but like you literally could show a picture and say how does this dress fit and it will
- give you reasonable feedback on that or how do you know what how do I undo this lock or what's this passcode whatever
- you want to do um so they're all multimodal they all are going to be doing voice back and forth they all
- connect to other do can read documents connect to other materials so that's kind of the basics all of that is
- connected to the large language model itself which you can kind of think of as the brain and so large language models
- basically get smarter over time so if we think about uh GPT 3.5 the free version
- you're using maybe High School sophomore I would say GPD 4 at its best moments is
- is a first year grad student so part of the question yeah so part of the question is what is two or four times
- better than that look like we don't know yet so we could just do raw test scores
- right we go from scoring at the you know at the 5ifth perc of the bar exam beating 5% of humans for free chat GPD
- to beating 95% of humans for GPD 4 what happens with the next one we we don't really know but so smarts are sort of
- the smarts of the brains behind the whole thing so this is the question I've asked everyone in this series uh to kind
- of end the episode if we're sitting here 10 years from now and we'll make a date
- I'm going to interview this I hope interview the same group of people 10 years from now what are we talking about
- do you think that has happened over the previous 10 years I can only think it's scenarios at this point right I mean
- because the the only question that kind of matters for this is how fast will these models improve and when will they
- hit their limits right and nobody knows the answer to those questions right so it's not going to be static if you think
- you have time to wait you don't because these model are advancing very rapidly the question is do they stop at the 95th
- percentile of the best humans in one area like so everybody's got something they're really good at that they
- definitely beat the AI in 99th percentile better than human we don't know right and so to me that's the only
- relevant question right and so nobody has the answer to that so we have to prepare for a scenario where okay we're
- getting close to the top I don't I haven't seen evidence of this but it's entirely possible that it starts to slow
- down then we still have at least 10 or 15 years of absorbing what gbd4 can do because it's barely connected to
- anything anything in the world right we've got 10 years of disruption ahead of us that's going to roll ahead anyway
- if they keep getting better then we start to think seriously about if not AGI what does it mean that it beats
- every human at you know writing marketing copy like what do we do with that right do we you know and so there's
- a lot of open questions so I don't have the easy answers but I think that there is I think we're you're more likely to
- see a transformed World in 10 years than in five even if the technology stops because it takes a while for systems to
- absorb change right the the the futurist rule is that everyone overestimates short-term change it underestimates
- long-term change I think 10 years we're going to see a transformed World in a lot of ways that are some are good some
- are bad well I'd like to thank uh Professor Ethan mik for joining me today on the podcast series on AI in education
- and the workforce uh Ethan's an associate professor of management he's also an academic director of whorton
- interactive and as he said you can go to your favorite engine and type in Ethan mik and you can see about his substack
- and about his videos on YouTube Ethan thank you for joining me thank you for having
- me
Brief Summary
Ethan Mik discusses AI's impact on education and workforce productivity, emphasizing prompt engineering and the need for adaptation in teaching methods.
Key points
- AI Disruption in Education. AI is transforming traditional homework, making it nearly obsolete.
- Democratizing Education with AI. Ethan discusses how AI can make education more accessible globally.
- AI's Impact on Workforce Productivity. A study shows a 40% improvement in task quality with AI assistance.
- AI's Impact on Performance. A 42% performance boost was observed in the bottom half of participants.
- The Jagged Frontier of AI. The discussion revolves around the evolving capabilities of AI and its implications.
- Biden's Executive Order on AI. President Biden signed an executive order addressing AI safety and security concerns.
Episode highlights
- AI Disruption in EducationAI is transforming traditional homework, making it nearly obsolete.“Homework is over!”1:03Nov 10, 2023
- Democratizing Education with AIEthan discusses how AI can make education more accessible globally.“AI can democratize education!”4:16Nov 10, 2023
- AI's Impact on Workforce ProductivityA study shows a 40% improvement in task quality with AI assistance.“40% improvement in quality!”13:31Nov 10, 2023
- AI's Impact on PerformanceA 42% performance boost was observed in the bottom half of participants.“The performance boost was at the largest for everyone in the bottom half.”16:02Nov 10, 2023
- The Jagged Frontier of AIThe discussion revolves around the evolving capabilities of AI and its implications.“Where is the jagged Frontier?”18:35Nov 10, 2023
- Biden's Executive Order on AIPresident Biden signed an executive order addressing AI safety and security concerns.“What is the policy trying to do?”19:37Nov 10, 2023
- The Rise of Deep FakesDeep fakes are becoming increasingly realistic, posing serious privacy concerns.“You shouldn't trust anything you see online anymore.”22:01Nov 10, 2023
- Future of AI and WorkThe conversation highlights the potential transformations in work due to AI advancements.“We're going to see a transformed World in a lot of ways.”27:30Nov 10, 2023





