What Will AI in Education Look Like?
Ask about Knowledge at Wharton
Episode Description
EPISODE OVERVIEW As a new school year unfolds, Wharton’s Christian Terwiesch reflects on how AI is changing education. This episode is part of the “Back to School” series.
PODCAST OVERVIEW Every day, business scholars answer pressing questions in their research - but what do their insights mean for you? In this podcast, Wharton faculty dive into what inspired their studies and how their findings resonate with the world today. Learn how research insights translate into knowledge you can use, with host Dan Loney.
Learn more at http://whr.tn/rippleeffect.
----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.
Launched in 1999, Knowledge at Wharton offers free access to:
- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox
Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU
Read the full transcriptHide the full transcript
- Dan Loney: Well, Artificial Intelligence is going to be one of the areas to focus on
- as we head back into the new school year. All levels of education are taking a look at the potential of AI, and what it
- could bring to education. But there are also some areas of potential concern. - Welcome to The Ripple Effect, the podcast
- that takes you on a journey through the minds of Wharton faculty. I'm your host, Dan Loney. And in each episode,
- we'll be diving deep into the inspiration behind the groundbreaking research that Wharton professors have
- conducted, and exploring how their findings resonate with the world today. - Pleasure to be joined here in studio by
- Christian Terweisch, who is professor and Co-Director of the Mack Institute for Innovation Management here at the Wharton
- School. Great to see you again. Christian Terweisch: Thanks for having me. Thank you. And so the interesting thing is, this is
- something that really came into your mindset in your teaching here at Wharton. You started to see AI as a component that you
- needed to focus on. Yeah, absolutely. So by way of background, many, many years ago, I have a background in computer science. Even had a
- class on neural network. But really put this topic to the side till Thanksgiving about two years ago. My kids were home
- from college and their work. And like many other families in this country, we talked about ChatGPT. And so the topic came up
- like, "Hey, Dad, you teach at a business school. Can ChatGPT take your final exam?" And so what we did is we just took my
- final exam in Operations Management for the MBA students, put it into ChatGPT, and it did pretty, pretty well. And
- so we put the story online, it went viral, and ever since, people believe I know something about AI.
- But did it surprise you that ChatGPT was able to do well on a Wharton exam? Absolutely. Not just that it did well. The way it answered
- the question, the level of sophistication of the language, the persuasiveness, the smoothness of the writing. It
- just blew my mind. - So how has that changed your thought process in how you teach, how
- you give exams? What— how has it impacted your operation? Well, the first reaction is, "Wow, this is big, right? This is
- a major productivity boost." Before we talk more about teaching, let's digress a little bit in what it means to have a
- productivity boost, right? We're going to see productivity boosts in many industries. For doctors, for nurses, for lawyers, for
- accountants, for radio hosts, for business school teachers, right? We're all gonna get more productive. But what does it
- mean to be more productive? So imagine— let's take a barbershop, right? I have a technology that makes the barber
- twice as productive. What does it mean? That barber can either make haircuts that are twice as good, or they can take
- twice as many customers and get a haircut? Right? So I'm shifting what we call the cost- quality frontier, because
- quality frontier has shifted out. And I can do now more with less. So what does it mean for teaching? Well, I can either
- teach more students, or I can hold the number of students I'm teaching constant and provide a better job. - What
- do you think it's going to mean most for students, in terms of how they go through their education process moving forward?
- I think you have to distinguish between two types of use cases, right? There's a use case for the students who get the same
- education as before, they could just get it in a more efficient and thus cheaper way.
- I remember many years ago, you and I talked about massive open online learning. - Yeah. Yeah.
- I taught one of the first MOOCs here at Wharton. So that was all about taking the
- Wharton experience and making it cheaper. Now, the other use case, and that's one I think we should be more bullish about, is
- we do a better job, right? The haircut looks twice as good. So we have to ask ourselves in education, what does it mean
- to provide education that is twice as exciting for the same number of students? Is there a level of concern about students maybe not having
- the level of learning on specific topics because they're relying on the component of AI to help them through the process?
- Absolutely. Right. So there's a concern, just take a calculator as an example, when the calculator came out, when spell
- checks came out, we were concerned— and I think rightfully concerned— that students would forget how to do
- basic calculations, and that they would weaken on their spelling. It's like if you take a pilot, and the pilot is flying
- autopilot all the time, is the pilot at risk of forgetting how to fly an airplane? Probably.
- The question of, though, the different levels of education and how they're going to be impacted— we're already seeing
- those types of discussions form at this point. Colleges are obviously thinking about it. Even high schools and middle
- schools are thinking about how AI can either be a tool to benefit the students' learning, but at the same time, being
- careful of the component of exams and tests that they're providing to the school as well. - Yeah,
- so let's stay with the exams for just a second. Again, you mentioned colleges and K12. I think there the impact is
- going to be very similar. The distinction that matters is, unfortunately, the rich and the poor, right? There are
- privileged universities and privileged private schools, Penn Wharton being one of them. And there, the question is
- all about, like, how can we take the students that we teach anyway, and provide them a better education? Now, I'm
- realistic about this. There are many situations in education where money is scarce. Today, think about public schooling in
- poorer areas. And there, the focus will be for— for the politicians, about how to make education cheaper. Most of
- them boost the frontier. That's a good thing. But I wish there would be more people who would benefit in the way that we could
- benefit at Wharton. - But obviously, just when you think about K through 12, just having the
- access to computers, and then obviously having the access to AI or ChatGPT as an assistant in, you know, doing research or
- doing a paper, that's a significant hindrance in many cases in different parts of the country. - I think most
- K12 teachers I've talked to will have the first reaction like, "This is going to be problematic." Right. And I think
- it's— sure I mean, if you have, basically, your brother-in-law taking the exam for you, I'm sure that is hindering the
- education process. In an institution like ours, we're certifying a specific skill for somebody. And if that
- certification is now weakened by the fact that we're not sure whether the person has the skill or the technology has the skill,
- we have a problem. - But I guess we shouldn't be surprised that that is somewhat the
- reaction that we're seeing right now, is because in many cases, when we see a new technology come on the board with great
- potential, there is a concern. There's a hesitancy that's out there. And it should be, right? I think— again, let's go back to
- calculators. On calculators, you might still remember how to do seven times seven. Let me just get the math right. It's 49, if
- I'm not mistaken. So you remember that. I remember that. But somebody who grew up in the age of the calculator, they might
- say, like, "I don't have to know seven times seven, I just ask the calculator." So you can now make the same argument for
- ChatGPT, where you say, like, "I don't know how to write an English essay, but ChatGPT can do it for me." So I think it
- really boils down to the question, like, what skills do we want to teach our kids? And what is the learning outcome that I
- want to have for my students in my course? And there's also the component of the development of the Chat
- GPT itself, with the different versions we've seen come out even in the short period of time, and how in the technical
- side can improve, you know, what's available for use in and around ChatGPT. Yeah, so I started using 3.5, version 3.5, about a year and a
- half, two years ago, for my initial exam. That did pretty well already. And then it was 4 coming out, and 4 Turbo. And now 4
- Omnichannel. It just got better and better. What are the discussions you've had with your students about the
- use of ChatGPT? What are the parameters and barriers that they can and cannot use? - I'm
- like a harsh German guy, right? So the rule is very simple. You're not allowed to use ChatGPT on the final exam.
- So that's the first and most important rule. The second one is, you can use it for case preparation and discussion. I've
- seen not too many students take advantage of that. But I expect that number to be growing. So I'm totally fine if you
- take the case, upload into ChatGPT and ask for advice, I think that's fair game. And then in class, we're typically not
- using it at all. I mean, I think it works best when students prepare for the case, for an assignment, in advance of class.
- So then seemingly we're looking at a time where we're going to go through a period where leadership of the education
- sector, whether it be colleges, universities or school districts, are going to have to have long conversations about what is
- allowable and what is not allowable around AI. - Yeah, I've wrote an Op Ed on the question of what is allowable
- and not. And I think it's helpful to distinguish between three types of tests. The tests that you do to certify a skill— and
- for those, don't use ChatGPT. Then the second thing is what I oftentimes do as a teacher in class, I ask my
- students questions to just get a sense of how they progress on their learning journey. And again, using ChatGPT would be
- misleading. The third type of test is really more like a homework that is hopefully engaging the students in the
- learning. And for that, if I can use ChatGPT to increase that engagement, that would be a good thing. But so always ask
- yourself, why are you testing? Tests are not for the sake of testing. As an educator, you have to always think, like, Why
- do I test? - How much do you think ChatGPT has impacted your profession right now?
- I think we're just seeing the implications for the academic profession. I use it for idea generation oftentimes. So I've
- wrote a paper that shows how ChatGPT outperforms human beings at coming up with ideas for new products or services. That
- is something that somebody who teaches innovation cares a lot about. I use it for writing. When I'm stuck with something, I
- say let ChatGPT continue that page for me. I think the key thing that you have to realize about ChatGPT is it still makes
- mistakes. But there are situations where mistakes are not consequential. So if I'm asking you for 10 ideas, and
- five of them are bad, I still get five good ideas. If I asked you to do heart surgery for me and five of those heart surgeries go
- wrong, that would be a disaster. So you want to use it in relatively low stakes environments, where you have a
- human in the loop so that you make sure— make sure that the quality is ultimately where you want it to be. Because
- ultimately, it's your name on the paper. And again, if you have that understanding that things like
- ChatGPT can be an assistant, be a guide, in the process of doing a test exam, or whatever it is, but still that you have to, you
- know, do the double check, but you know, fall back and make sure that everything is proper and in working order, then it
- can be a benefit for good, moving forward. - Absolutely. Right. I think if all we ended up is a world where we
- were three years or four years ago, we would have wasted a huge opportunity. - Where do you think
- we're gonna go with education, then, longer term, with things like AI and ChatGPT in the process?
- So, I think it's going to increase access, first of all. There are many people living in the world— that goes back to our
- MOOC discussion, when we started the MOOCs— so many people in the world who don't have access to an education like here at
- Wharton. And we can basically share and open the gates to those people. I think that's a good thing. That is all about
- making things more efficient. For the people who are at Wharton, I hope we can do a better job educating them. We
- can create some really awesome learning experiences. I know Ethan Mollick and the folks building simulations are already
- actively working on that. We can create real kind of increases in the quality of education, just like the person, the
- barbershop is providing better looks to their clients. Christian, great to talk with you as always. Thanks very much
- for your time. Thanks for having me here. You got it. Christian Terweisch, professor and Co-Director of the
- Mack Institute for Innovation Management here at the Wharton School. - Thank you for listening to The Ripple Effect. We hope
- you found this episode informative and engaging. Don't forget to subscribe and leave us a review so that we can continue
- to bring you the best insight from the Wharton School.
Brief Summary
Christian Terweisch discusses AI's impact on education, focusing on ChatGPT's role in teaching and concerns about student learning.
Key points
- AI's Impact on Education. Christian Terweisch explores how AI like ChatGPT is changing teaching and learning dynamics.
- Concerns Over AI in Learning. The conversation highlights concerns about students relying too much on AI for learning.
- Future of Education with AI. Terweisch discusses the potential for AI to increase access and improve education quality.
Episode highlights
- AI's Impact on EducationChristian Terweisch explores how AI like ChatGPT is changing teaching and learning dynamics.“ChatGPT did pretty, pretty well on my final exam.”1:25Aug 13, 2024
- Concerns Over AI in LearningThe conversation highlights concerns about students relying too much on AI for learning.“This is going to be problematic.”5:47Aug 13, 2024
- Future of Education with AITerweisch discusses the potential for AI to increase access and improve education quality.“We can create real kind of increases in the quality of education.”11:24Aug 13, 2024



