How Disinformation Spreads Online

Knowledge at Wharton

Ask about Knowledge at Wharton

Episode Description

EPISODE OVERVIEW Wharton Professor Eric Clemons breaks down how disinformation spreads so effectively on social media, why highly processed and targeted content outperforms traditional news, and what makes truth harder to communicate in today’s digital environment. He explains the difference between misinformation and disinformation, the role of platforms and profit incentives, and what it may take to reduce the impact of manipulated content without limiting free speech.

PODCAST OVERVIEW Every day, business scholars answer pressing questions in their research - but what do their insights mean for you? In this podcast, Wharton faculty dive into what inspired their studies and how their findings resonate with the world today. Learn how research insights translate into knowledge you can use, with host Dan Loney.

#Disinformation #AlgorithmBias #MediaManipulation #CognitiveBiases #TechEthics ----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.

Launched in 1999, Knowledge at Wharton offers free access to:

- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox

Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU

Read the full transcriptHide the full transcript
  1. If I told you uh sincerely that Hillary Clinton ran a child pornography web out of a pizza parlor in Virginia
  2. and had dozens of kids chained to the wall, you would either find it amusing cuz you know it's false or you would
  3. find it terrifying because you know there are people who would believe it. Welcome to the Ripple Effect, the
  4. podcast that takes you on a journey through the minds of Wharton faculty. I'm your host, Dan Looney, and in each
  5. episode, we'll be diving deep into the inspiration [music] behind the groundbreaking research that
  6. Wharton professors have conducted and exploring how their findings resonate with the world today. Well, there is
  7. really no doubt that we have seen social media platforms [music] have to deal with growing levels of disinformation in
  8. recent years and on a wide range of topics. The reasons why this is occurring can obviously be political,
  9. can be profit centered and there are so many other reasons. But how can these issues of diff disinformation be dealt
  10. with? Pleasure to be joined by Eric Clemens who's professor of operations, information, and decisions here at the
  11. Wharton School and he was part on new research on this topic earlier this year. Eric, always great to chat. How
  12. are you, sir? >> Uh, I'm okay. I'm missing a front tooth so I hope I don't look too goofy for
  13. your audience. >> You're good. You're good, Eric. >> I'll try to avoid smiling. This is
  14. obviously such an important topic right now, but let me start with something that is noted right at the top of the
  15. research and you talk about the component of campaigns and how much the the the concept of a campaign is really
  16. involved in much of these issues around disinformation. >> Yeah. Uh one of the things that's
  17. interesting is how effective it is. uh disinformation about climate change is easy. You tell a bunch of coal miners
  18. that it's a Chinese plot to uh the American coal industry, increase the cost of American production, and
  19. increase uh Chinese welfare, Chinese well-being. You tell someone who lives in a uh coastal community that uh just
  20. because somebody missed seven foul shots, uh you don't trade them, >> right? >> Uh bad bad stuff happens and a couple of
  21. bad hurricanes in a row doesn't mean you should sell the house or get rid of your
  22. SUV. That's easy to say. The explanation for climate change is so complicated. Uh
  23. we all know how a microwave works. The radiation in a microwave makes water vibrate, which is the definition of
  24. heat. Radiation from the earth makes carbon dioxide vibrate, which is the definition of heat. Why we don't melt.
  25. Uh it's called black body radiation. Eventually, you reach a new equilibrium. I gave my class uh an experiment which
  26. was I told them a couple of climate change lies which were easy to repeat and I told
  27. them some climate change truth which is hedged and incredibly complicated and none of them could repeat it. I was
  28. stuck on an airplane and the poor passenger stuck between me and the aisle had just bought a house uh off the Outer
  29. Banks. And at the end of two hours, he said, "Let me see if I understand. If I'm very lucky and every bit of data we
  30. have on carbon dioxide is false, and if cloud cover cools the Earth, I'm fine. Otherwise, my house is going to be
  31. underwater in 10 years." And I said, "Yeah, it could be okay." But he said, "I'm selling. Why doesn't every American
  32. in in why doesn't every American know this?" And I said, "You were stuck for two hours with nothing to do but listen
  33. to me." >> Right? >> I don't have that opportunity, and I don't have the time to talk to 20
  34. million voters. But the lie is easy and effective. The truth is long, slow, and complicated. Makes it a very effective
  35. way to change opinions. And so when you put it in a campaign form, it becomes that much more effective.
  36. >> It it it does. Now, a lot of uh the things that are banned in uh disinformation campaign are sort of
  37. banned in old marketing law. But this is so complicated. It's moved so quickly. uh platforms have so many exemptions and
  38. the profit motive to be paid to facilitate a campaign is so high that it's really been almost impossible to
  39. control. >> And so one of the other things you mention is that uh social media content
  40. this disinformation in many cases is quote unquote highly processed similar to many of the foods that we eat.
  41. Correct. >> I love the analogy. We are finally understanding that highly processed food
  42. isn't the same as as a balanced diet and highly processed news isn't the same as
  43. an informed uh electorate. Uh that's it's exactly right and I I should explain a little bit what highly
  44. processed means in the context of of news. The first part is I know what you're inclined to believe. I know what
  45. you know. The amount of information available on every social media users is incredible. Recent studies have shown
  46. that social media models can predict the behavior of a user more accurately than
  47. their spouse. I mean it's it's we we know enough and if we share that information with a highly motivated
  48. liar, let's call it leave us out of it and call it a North Korean troll factory, they can write stories that
  49. will appeal very closely to individual segments of the market without actually needing to violate any individual's
  50. privacy. So I now know enough to have highly processed lying, very effective targeted
  51. lying. If I send that to everybody, if I told you u sincerely that Hillary Clinton ran a child pornography
  52. web out of a pizza parlor in Virginia and had dozens of kids chained to the wall,
  53. >> you would either find it amusing because you know it's false or you would find it
  54. terrifying because you know there are people who would believe it. Highly processed news also goes to the people
  55. who want to believe it. >> So then how different then is news that people see on a social media platform
  56. from what we see on a network newscast or if we read it in a newspaper >> changing a little bit since the Bush
  57. administration basically got rid of the FCC's fairness requirement. But but still if the New York Times runs
  58. a story, it has to be plausible to all of its readers. If readers find it preposterous,
  59. it loses its credibility, which destroys its value as a brand. Uh with the in the
  60. case of social media, uh the social media's brand is entertainment. And as long as I show stuff that people
  61. find entertaining, I'm protecting and enhancing the brand. I'm not weakening it. So there's no
  62. penalty uh to Facebook or no penalty to Twitter for highly focused, highly targeted
  63. lying, whereas this would destroy the brand of the New York Times or for that matter NPR.
  64. So most broadcast uh channels attempt to have at least some element of universal plausibility.
  65. Even Fox News, which is about as biased as a network can be, even Fox News on their news programs, news segments,
  66. attempts a certain amount of uh reliability. Their editorials are a different story. When I wanted to get
  67. unprocessed news about the Middle East, I actually got it from Al Jazer because Al Al Jazer is so vulnerable to claims
  68. of being false that their news is is as reliable as the uh as the Financial Times. Their editorials are a different
  69. story. I don't spend a lot of time with uh Alazer editorials, but their news has
  70. to be accurate or they they have no credit. they they lose whatever credibility they have.
  71. >> You make a distinction in the in the paper that you wrote about this topic between misinformation and
  72. disinformation. Please take a moment to explain the difference. >> Sure. If I actually believed that um oh
  73. that the election was stolen and I repeat that or I actually believe that uh vaccines cause autism
  74. uh or that um uh Joe Biden was fully competent even going into the debate. If I truly
  75. believe that and I repeat that, I post that, I repost that, that's misinformation.
  76. >> Mhm. >> If I tell stuff that I I believe for the purpose of sharing my view of truth,
  77. again, that's misinformation. But if I know something to be false, I'm actually working in a troll factory or
  78. I'm working for a political campaign and I design really effective arguments to spread falsehood.
  79. That's disinformation. Misinformation is protected by the first amendment. Disinformation is not. So why then is
  80. disinformation so hard to control? >> A variety of reasons. One is uh one man's um disinformation is
  81. another man's uh political campaign. Right. Uh we I've got to assume that most people in the Trump White House
  82. know that he lost the previous election and yet they went after um companies for
  83. v voting machine companies for fraud. Uh they're fighting to block um mail-in voting,
  84. >> right? Be >> because it's effective. So there are there are times you do stuff I've I've
  85. said this before. This is not a Democrat or a Republican issue. It's a liberal or
  86. conservative issue. Liberals by definition consider almost everything discussible. I don't mean inifat. I
  87. don't mean u radical anarchists. By definition, a political liberal in the definition from the late 1700s
  88. believes everything is discussable. Uh for the truly committed, you're doing God's work.
  89. >> Right? >> So if you're doing go the guy who said, "I will I disagree with what you say,
  90. but I will defend to the death your right to say it." He wasn't part of the Inquisition.
  91. >> Right. >> Right. I mean, he he wasn't doing God's work. Well, and as you bring up, the
  92. First Amendment obviously plays a very important role in this process of bringing a lot of this information to
  93. the forefront to begin with. >> It it does and the first amendment is a very good thing. The first amendment is
  94. based on the idea that truth wins in the free market for ideas, >> right? >> Similarly, trial by jury isn't perfect.
  95. The idea is both parties do their best. They hire the best attorneys. They they don't lie, but they manipulate
  96. perception as best they can. And the idea is in the end, the best idea wins. Uh it doesn't work when technology
  97. allows highly processed news. It doesn't work when I can craft a story specifically for you to believe and then
  98. make sure you're the only one who sees it. are are traditional news outlets that we have known for decades,
  99. are they impacted negatively because of what I think is the mindset around bringing information forward, news
  100. information forward on social media in this day and age. I mean, this is something that is really geared for
  101. where we are right now. The countries that have the strictest rules on the use of information, uh,
  102. nations in the EU would be the nations that you would expect to be least affected by highly processed news. And
  103. four or five years ago, I met with the head of strategy for a traditional Danish broadcaster
  104. and she showed that her market share in almost all areas had been reduced by about 75%.
  105. And she said her stories have to be true. They have to be the same for everyone. As soon as she starts varying
  106. what you see based on what you want to believe, she loses her license to broadcast.
  107. And she pointed out that social media is is much more entertaining. There's been
  108. some research that shows that when we watch TV, we want to be entertained, >> right? And we view social media as
  109. entertainment. Uh there's a work by um uh two famous Nobel laurate behavioral uh economists conne
  110. uh conneeded out that we have type one and type two thinking right >> fast and slow fast is something's wrong
  111. I have to get out of here slow is complex and analytical he said we we watch the the fake news researcher said
  112. we watch fake news with fast thinking. Is it entertaining? We don't say is it correct? It's one of the reasons why
  113. labeling demonstrably false news as false and originating in Russia, China, or North Korea has very little impact on
  114. people's reposting it because it's fun. >> Yeah. >> So fun fun Trump's real media. I don't
  115. want to use the word Trump in that context. fun beats traditional media on on reposting. It beats traditional media
  116. on market share. It's just compelling. It wins. But then is there I think a lot of people would also say that um you
  117. have to look at the importance of what social media has become and that it's in our culture and knowing that it's going
  118. to be around our culture. But how do you deal with the level of disinformation that we have there
  119. but still allow social media platforms to be fun for people who would like them to be fun?
  120. you know, to kind of take the the negative and the angst out of social media. >> I have an example of a social media
  121. website that is so trivial that it was able to police itself until it was bought by Anheiser Bush. And it was a
  122. craft beer rating site. >> Okay. >> And I could say, "Who's got the profile most like mine?" And it turned out to be
  123. a guy named Ratman. Uh, and I would say, "What did Ratman think of this beer?" And he would say,
  124. "Even for me, too bitter." Well, all right. I would, if he didn't like it, it's certainly too much of an IPA for
  125. me. [snorts] There was one beer introduced by a brewery and they obviously told their employees
  126. to love it and suddenly there were thousands of positive reviews for a beer, all coming from the same location,
  127. the location of the brewery. >> Right. I I had it pulled because we could we could police it. It really
  128. didn't it didn't matter. Um how do you police social media? Well, the first thing you do uh is you prohibit the
  129. social media from sharing aggregate statistics. This is one of the reasons why Tik Tok's claim to be safe is
  130. patently false. Tik Tok doesn't have to move any data on any individual out of the US. It simply needs to categorize
  131. individuals into buckets of what they believe. And that data doesn't have to leave the
  132. states. Uh China can craft stories and send them to Tik Tok. Tik Tok can post them and direct them to the people who
  133. want to read them. And none of this violates privacy law. >> Right? So if you want to um limit the
  134. effectiveness of highly processed fake news, you take away the processing factory. You don't let Facebook share
  135. data, even aggregate data on people's beliefs. You don't let Facebook uh post stories to individuals who are
  136. responsive to them. That's hard to do because aggregate data doesn't violate privacy law, right? And
  137. Facebook has successfully argued in front of the EU that sending you a story that you love is part of their
  138. commitment to be a good entertainment company. So it's it's not easy to do this, but if you take away the raw
  139. material, you shut down the processing factory, then social media becomes just a just a blackboard.
  140. So then realistically, as we're moving forward, you know, further down the road here, the concept of disinformation is
  141. something that we will probably see stay around for the foreseeable future. If you remember 1984,
  142. which was >> the book or the year? >> The book. >> Okay. >> If I said there's this old joke, do you
  143. remember 1968? And the answer is if you were there, you don't remember it. >> Right. Right. Right.
  144. >> But but uh the book was originally titled 1948 and the expectation was technology would enable this degree of
  145. societal manipulation very quickly. >> Right? >> It didn't. But it we're we're we're
  146. getting there. So, social media will be around forever. Lying has been a tool of
  147. statecraft and a tool of Warcraft uh forever. Absolutely forever. The difference is between traditional oneoff
  148. lying which is highly effective only when a society is falling apart and highly targeted lying which works
  149. most of the time. >> Right? >> So we've we've got a society where there is a strong motivation to win. There are
  150. people who truly believe they're doing God's work >> and they have the tools to manipulate.
  151. What we have to do if if we want to limit it without limiting free speech is deprive the the tools of the data needed
  152. to process, create, and direct the news. >> Eric, great conversation. Thanks very
  153. much for your time and obviously continued success with your work. All the best. Thanks so much,
  154. >> Eric Clemens, professor of operations, information, [music] and decisions here
  155. at the Wharton School. Thank you for listening to The Ripple Effect. We hope you found this episode informative and
  156. engaging. Don't forget to subscribe and [music] leave us a review so that we can
  157. continue to bring you the best insight from the Wharton School.

Brief Summary

Eric Clemens discusses disinformation's impact on society and the challenges of combating it through social media and campaigns.

Key points

  • The Ripple Effect Podcast. Join Dan Looney as he explores the impact of Wharton faculty research on today's world.
  • The Challenge of Climate Change Lies. Exploring how disinformation campaigns exploit complex truths about climate change.
  • Social Media as Entertainment. How social media prioritizes entertainment over truth, affecting public perception.
  • Disinformation vs. Misinformation. Understanding the critical difference between misinformation and disinformation in today's media landscape.
  • The Future of Disinformation. Discussing the ongoing challenge of disinformation in the age of social media.

Tension

45/ 100Some tension

Related episodes