Inside the Growing Market for Digital Companionship
Ask about Knowledge at Wharton
Episode Description
ABOUT THE EPISODE Stefano Puntoni explains how chatbots are increasingly becoming emotional companions. His research shows that even short conversations with a bot can reduce loneliness, especially for people who feel the most isolated. He also notes that real user transcripts reveal many individuals turning to AI companions while facing serious mental-health struggles, which raises concerns about safety and responsibility. As demand grows, startups embrace the companionship market while major AI companies stay cautious, partly because of rising lawsuits claiming harms ranging from unlicensed psychotherapy to wrongful death.
ABOUT THE PODCAST This Week in Business features interviews with Wharton faculty about the latest news, fascinating trends, and issues impacting both consumers and the business world. Episodes are recorded at the Wharton School and published twice per week.
#AICompanionship #HumanAIInteraction #AIEthics #AIWellness #AI ----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.
Launched in 1999, Knowledge at Wharton offers free access to:
- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox
Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU
Read the full transcriptHide the full transcript
- AI has been looking to develop and enhance a wide range of areas, even how we deal with certain human emotions like
- loneliness. It is something that people have had to deal with since really time began. But can chat bots alleviate or
- eliminate some of the issues around loneliness and what might that mean for things like other medical issues
- potentially something like mental health. Pleasure to be joined here by Stephano Panton who's a marketing
- professor at the Wharton School and co-director of the Wharton Human AI research project. Stephano, great to
- talk to you again. How are you, sir? >> I'm good and great to be here. Thanks, Dan.
- >> You know, the thing is we've talked in so much about AI in the business sense
- or the professional sense. We haven't talked about it a lot from the human sense and how consumers are thinking
- about chat bots. So, what are you seeing play out right now? >> Yeah. So we uh in the business
- conversations around AI. Lots of the use case that we talked about are you know uh professional or um uh for
- productivity and work and things like that. But lots and lots of people all of us really are using chatbots in our
- lives as consumers and we use them for a variety of different things. We look for
- information. We are trying to learn skills. we uh just play with it in some way and uh we get a lot of you know
- useful things done with it from recipes to best time stories and lots of other stuff. But uh one use case that has been
- uh uh become quite prominent and that maybe you know people wouldn't maybe expect uh to that extent until recently
- is the use chatbot for companionship. The idea that you can have what you can call maybe a synthetic friend a or
- partner a chatbot that uh plays out the role of being uh a relationship to you so that you can engage in socio
- emotional processes whether those are you know um friendship based or or um coaching or mentoring based or or maybe
- even romantic and sexual uh in nature. I would think though for something like that, consumers would want to and in
- many cases need to see it actually occur, you know, actually be in action in order to understand kind of the level
- the capabilities that that this might have. It sounds a bit of a crazy idea that you would basically um you know go
- on a chatbot to find a friend, but uh you just have to spend a bit of time using these technologies just to
- understand how humanlike they really are. Especially today when the AI companies are adding a voice layer to
- the system so that you can interact not through text but through voice. is incredibly humanlike. And in our own
- research, we find that people don't expect uh to um see much benefit for you know things like loneliness but uh uh
- they do in fact find that when they try it. So to some extent for many consumers
- might become more um appealing a use case as they get used to the technology. >> So what's going on then in this market?
- I mean how is this developing and and who are some of the main players in this process right now?
- >> Yeah, so this is a burgeoning area. It's been uh really interesting to see how
- this is uh developing. On one hand, you could say the big AI companies are being
- very careful to in a way stay away from this compishing angle. So if you take for example uh OpenAI and Chach, they
- are making I think an admirable and very good job at trying to avoid humanizing the technology. there's no name, you
- know, humanlike avatar. Everything is very tech and explains to you that this is a chatbot at every turn. And I think
- that uh that is besides it to try to avoid some of the uh liability or risks that might come with uh this kind of
- market. Maybe uh we might see that changing a little bit uh uh with time. Certainly we've seen uh say Grock being
- much more aggressive in this space than some of the other big AI companies and otherwise has been less to smaller
- startups companies like Character.ai or Replica that have millions of uh active users and um where a lot of people are
- you know playing with but also uh forging relationships with these spots. >> You were also part of research that
- looked into how AI chatbots might impact something like mental health. Yeah, we've done a few research projects. This
- uh this line of research is led by Julian Desertus from Harvard Business School and what we are doing is
- basically to uh try to explore the consequences of chatbots for these social emotional processes. We have one
- paper where we explore the impact on feelings of loneliness like you hinted at earlier where basically we are have
- participants engage in a 15 minutes conversation with a bot and we measure feelings on loneliness before and after
- the interaction and we find that they're quite effective at reducing loneliness and we find also that those people for
- whom the effect is largest are those people that report higher levels of baseline loneliness. So perhaps uh you
- know that that could be some kind of a tool for the alleviation of um loneliness's societal level. We also
- have in another project um we have an audit of AI systems and then we are looking at actual transcripts of uh
- consumer interaction with bots and we find evidence that a small percentage of individuals uh interacting with these
- bots is likely to be experiencing quite severe mental health issues which obviously raise some consumer safety
- concerns. This technology is not meant to be a let's say mental health tool or an FDA regulated. Well, that element of
- of consumer safety becomes an important component of this conversation, doesn't it? And for the companies that are
- developing these technologies, they have to be wary of, you know, potential reputational risk that might hurt their
- uh business longer term. >> Yeah. Not only reputational risk, even uh uh liability legal uh in a legal
- sense. And I think when I was saying earlier that some of the big eye companies have been cautious in the
- companionship domain is probably coming partly from this. And so right now there
- is around a dozen lawsuits making their way in the courts. Some of them have been high-profile cases at uh newspapers
- like the New York Times have been featuring multiple times and they're directed mostly towards AI companion
- companies especially Character.ai AI as a few but also recently there have been lawsuits to go towards open AI making it
- the point that even though chach is not meant to be an AI companion people can craft prompts that create a companion
- out of chachet and that the company hasn't been monitoring that activity enough. I'm just uh had recently I went
- to a conference when I saw a presentation by one of the key lawyers bringing uh some of these cases to court
- and the list of uh claims being made is quite uh quite something. I can read it to you. Product liability, religions,
- unlicensed practice of psychotherapy, harmful death and slaughter and encouragement of suicide. We'll see
- what's happening with these lawsuits. uh but certainly this is also an element of
- pressure on AI companies and >> but for for the conversation we're having here though this like a lot of
- things around AI still feels like it's very much in the development process right now correct
- >> yeah I mean these models are improving very rapidly companies are learning uh
- how to deploy these models for uh many um uh use cases also learning how to build safety guard rails
- And this space is very develop still very developing very fast. So I think it's a bit early to tell um what uh you
- know this will look like a year or two from now. But it's quite clear that a um chatbots can be very effective
- companions at least give this sense of companionship this illusion if you wish depending a little bit on your point of
- view and b that there is a lot of demand from uh from consumers for companionship
- of that sort. So um certainly there's going to be a lot of market pressures towards uh growing this comparatorship
- area while there are also obvious liabilities and concerns like we discussed. >> Stephano always great to talk with you
- and get your insights. Thanks very much. All the best. >> Thank you. >> You got it. Stephano Penton, marketing
- professor here at the Wharton School and also co-director of the human AI research project.
Brief Summary
AI chatbots may help alleviate loneliness, but raise mental health concerns and legal risks.
Key points
- AI and Loneliness. Exploring whether chatbots can help alleviate feelings of loneliness.
- The Role of Chatbots in Companionship. Chatbots are increasingly being used as companions, surprising many.
- Legal Concerns for AI Companionship. AI companies face lawsuits regarding their chatbot technologies and potential risks.
- The Future of Chatbots. Chatbots are evolving rapidly, with significant consumer demand for companionship.
Episode highlights
- The Role of Chatbots in CompanionshipChatbots are increasingly being used as companions, surprising many.“It sounds a bit of a crazy idea.”2:26Dec 3, 2025
- Legal Concerns for AI CompanionshipAI companies face lawsuits regarding their chatbot technologies and potential risks.“The list of claims being made is quite something.”7:12Dec 3, 2025
- The Future of ChatbotsChatbots are evolving rapidly, with significant consumer demand for companionship.“It's quite clear that chatbots can be effective companions.”8:11Dec 3, 2025





