Schools Risk Overreliance and Lost Connection with Unrestricted AI in Learning

Knowledge at Wharton

Ask about Knowledge at Wharton

Episode Description

ABOUT THE EPISODE Wharton professor Hamsa Bastani discusses the use of AI tools like Google Gemini in K–12 schools, sometimes with unrestricted student access. She notes that this can lead to overreliance, make it harder to build fundamental skills, and reduce motivation by removing the sense of accomplishment. She says budget limits and lack of teacher training often lead schools to adopt AI in the “path of least resistance” without tailored guardrails. Bastani also warns that AI use can reduce interaction between students, teachers, and parents.

ABOUT THE PODCAST This Week in Business features interviews with Wharton faculty about the latest news, fascinating trends, and issues impacting both consumers and the business world. Episodes are recorded at the Wharton School and published twice per week.

#AIinEducation #ArtificialIntelligence #EdTech #EducationTechnology #StudentLearning #LearningSkills #TeachingAndLearning #EducationInnovation ----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.

Launched in 1999, Knowledge at Wharton offers free access to:

- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox

Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU

Read the full transcriptHide the full transcript
  1. Dan Loney: Well as our kids get ready to head back to school, we need to look at the role that artificial intelligence will be
  2. playing in that learning process. You are seeing quite a few school districts looking to figure out how they are going to
  3. incorporate it into their processes this year and beyond. Pleasure to be joined by Hamsa Bastani, who is an Associate
  4. Professor of Operations, Information and Decisions here at the Wharton School. Hamsa, great to talk to you. How are
  5. you today? Great. Thank you so much for having me, Dan. You know, I mean, we have AI conversations so much about so
  6. many different things. This is not a surprise that we're having one about education. But I guess the question is just how it will
  7. be included— not necessarily in the college process. We're seeing that already. But in high schools, in grade schools, what
  8. are you starting to see and hear from from some school districts? Yeah, I actually just got off a conversation with some of
  9. the teachers in in a high school, and they were talking about how this year they're going to start using Google
  10. Suite in the class. So they'll have Chromebooks for every student, and they're going to have access to Gemini and other
  11. tools like NotebookLM, which is unfettered access to AI. One of the things I've talked about in my research is that, you know,
  12. giving students unfettered access to AI can harm their learning, because they actually tend to over-rely on those
  13. tools. The number one question they always ask is, what's the answer? So I'm asking them, you know, why are you choosing
  14. that instead of, you know, something like Khan Academy or one of these ed tech tools that maybe has better built
  15. guardrails to support learning, or a Socratic learning method? And they said that ultimately, you know, our kids are going to go
  16. into the workplace and use these tools with unfettered access, and so that's what we're trying to prepare them for.
  17. But are the kids at this point ready to have unfettered access? Like, have they— have they learned enough about what AI is
  18. and how it can impact them, that we could just go ahead and let them, you know, kind of get going with this?
  19. I don't think so. So that's what I worry about. So as a researcher, it's kind of an exciting time. But as a parent
  20. and an educator, it's not a great time. I think it's very concerning. I mean, I don't think anyone knows the answer,
  21. but what we've seen from at least our research studies is that students need to build the fundamental skills
  22. first and then they can effectively use AI tools. And even then, you might have some worries about de-skilling but
  23. if you don't have the basic fundamental skills down, then it's very difficult to even assess the outputs that AI is
  24. producing. And then it's also a huge cognitive load for them, because they're trying to process all this new
  25. information, so they can't actually check the outputs and collaborate effectively with these tools. So I worry about
  26. that. The other thing I worry about is just taking away their sense of accomplishment, right? One thing that we see is— and
  27. this is so important for kids, you know, that they have to feel that they have something to contribute, that they did
  28. something that they can be proud of. And when you're just prompting an AI tool and reporting back those results,
  29. you don't have that. And that's one of the reasons we see diminished motivation and engagement.
  30. Is there also an element of this, that if they are going to do unfettered access, that they feel this is the easiest way to
  31. implement it. I'm speaking about school districts. - Yeah. - Without necessarily having to
  32. make the investment on the teaching side, on the learning side— because we know, with a lot of school
  33. districts right now, budgets are tight already, and it's hard to add new things to what they already have in place.
  34. Yeah, I think it's very much the path of least resistance, right? It takes a lot of work to go figure out, what are the right
  35. guardrails, what are the right pedagogical innovations that you can use to leverage these tools? And, you know, like Ethan
  36. Mollick and I've also been talking about like, it's actually difficult that that's an open research question. It
  37. takes a lot of exploration, creativity and work, and school teachers are not paid enough to do that work. They have no
  38. dedicated time or training to do that. Administrators, like you said, they have, you know, limited budgets. Just giving
  39. everybody access to, you know, one of these Google Gemini Suite or OpenAI subscriptions is kind of a cheap investment, right?
  40. And so it's kind of easier and it's less likely to be criticized. So I think it's kind of just going down the path of
  41. least resistance. And you see teachers reacting the same way. They're very much going back to— a bunch of them are like, "Can we
  42. find good plagiarism detectors? Can we just have students write in their blue notebooks?" Also things that are not going to
  43. work. And I think, you know, without creating the time and space to explore and understand this better, this is what you can get.
  44. But something you said a little bit ago, really, let me circle back to it, is— there is something about when a kid, a
  45. child, comes up with an idea by themselves, on their own. It becomes very successful in the classroom. That that's the
  46. similar formula that they need to implement when they're out in the workplace as well. We can't just rely on AI in the
  47. workplace, because it's — for me, I mean, it's like acting like a crutch. It's— it's— it will help you along, but it won't serve
  48. the larger good. I 100% agree with you. I mean, also, if you could rely on the AI, then why do we need humans? We're going
  49. to end up firing our entire workforce. So we need to train people to add value above and beyond these AI outputs. And one
  50. of the things that really bothered me was, my colleagues and I ran a study on chess, right? We hear AI has been
  51. much better than students for a long time, but people still play chess for the love of the game. And one of the things we found
  52. is that if we gave students— we followed them for about three months. We gave them different AI tutoring platforms. If we
  53. gave them the ability to click a button that lets you figure out the answer, or give you the next move without having to think
  54. through it, they kind of started getting addicted to using that button. And they found chess less fun, because when you
  55. figure out a really complicated move that, you know, gets you a piece or wins you the game, that's when you feel great, even
  56. though it's a lot of work and a lot of struggle to get there. And so by illuminating this struggle, it's very difficult to
  57. say no to that, because we don't like the struggle. We're also removing the sense of accomplishment.
  58. So then is the expectation— and I'll say this just from my perspective of just talking with you here for a few minutes— that
  59. while schools will implement AI, that this will still be a learning process for the schools, to some degree, to
  60. understand its uses, its implementation, how it will impact students, you know, as we move forward? It may not be, you
  61. know, totally 100% just put it in and don't worry about it ever again. That there will have to be some watch and some
  62. some research on just how it kind of focuses in to what students deal with in schools?
  63. My perspective is probably a little bit more pessimistic than that. I guess— okay, so historically, we've had policies
  64. that we've invested lots of money in, like one laptop per child, or the LA iPad, where we just threw money and technology
  65. at kids and hope they would learn better. And they have not worked, and sometimes they even have negative effects. The other
  66. especially pernicious thing, I think, about generative AI, is that now kids are not seeking their teachers for help, so
  67. we're losing the human connection. So we don't even know what's going on with our students. They don't come to
  68. office hours anymore. They don't ask for questions. They don't— parents tell me that, you know, their kids don't come and ask
  69. them for help with their math homework anymore, because they can just ask ChatGPT. So how would we even know what's
  70. going on with our kids? No one's— no one's talking to them, and that combination, I really worry about.
  71. Hamsa, great to talk with you today. Thanks very much for your time. Thank you, Dan.
  72. Thank you. Hamza Bastani, who's an Associate Professor of Operations, Information and
  73. Decisions here at the Wharton School.

Brief Summary

Hamsa Bastani discusses AI's impact on education, highlighting concerns about student reliance and the need for fundamental skills.

Key points

  • The Role of AI in Education. Exploring how AI tools are being integrated into classrooms and the potential risks involved.
  • Concerns Over AI Dependency. Hamsa shares worries about students over-relying on AI tools for learning.
  • The Human Connection in Learning. The impact of AI on student-teacher interactions and the loss of personal guidance.

Tension

45/ 100Some tension

Related episodes