What Impact Will AI Have on Organizations? – Bob Meyer & Roger Gu | AI in Focus Series

Knowledge at Wharton

Ask about Knowledge at Wharton

Episode Description

EPISODE OVERVIEW Wharton professor and Faculty Co-Director or AI at Wharton Bob Meyer and Wacai co-founder and president Roger Gu join Eric Bradlow, vice dean of Analytics at Wharton, to discuss how AI is changing industries and organizations, touching on real-life applications like robo-advisors, customer engagement, marketing, and more. This interview is part of a special 10-part series called "AI in Focus."

Topics and questions covered: 00:00 - Introductions 1:15 - Examining AI's potential applications 3:36 - Exploring AI uses at Wacai 6:45 - Analyzing consumer reactions to AI 9:19 - Wacai President Gu's strategy for AI delegation 13:41 - Assessing task importance heterogeneity 17:31 - Could humans trust AI too much? 19:57 - AI applications in FinTech and marketing 24:22 - Potential frontiers of AI

SERIES OVERVIEW The artificial intelligence revolution is officially upon us. Hear from host Eric Bradlow, Vice Dean of Analytics at Wharton, as he meets with Wharton faculty experts across a wide range of business domains – from healthcare and neuroscience to sports and the auto industry – to learn how AI will impact these fields moving forward, and what we can do to stay ahead of the curve.

----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.

Launched in 1999, Knowledge at Wharton offers free access to:

- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox

Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU 📂 Technology;AI 🏷️ Research;AI in Focus

Read the full transcriptHide the full transcript
  1. welcome to the next installment of the analytics at Wharton series focused on artificial intelligence I'm Eric bradow
  2. professor of marketing and statistics here at the Wharton School and I'm also Vice dean of analytics at Wharton we
  3. think one of the important applications and areas that we as a business school should focus on is what we're calling
  4. today's session AI in action and I can think of no two better people to speak to us about this than number one my
  5. colleague Bob Meyer who will be joining us Bob is the Frederick H eer bet life insurance Professor he's also the
  6. co-director of the Wharton impact of technology initiative so first Bob uh Welcome to our podcast welcome it's good
  7. good to be here and then second um is Mr Roger Goo uh Roger is the co-founder and
  8. president of Wai a prominent independent mobile based platform for comprehensive
  9. Wealth Management in China uh Rogers got a career spanning multiple decades both
  10. in the United States and in China he also serves and I'm very proud to have Roger both as a friend but as a valued
  11. member of the analytics at Wharton Advisory board so Roger Welcome to our podcast well thanks for having pleasure
  12. so Bob let me start with you um you do a lot of work on the impact of technology
  13. let's call it broadly defined on human behavior so could you all and of course employees are humans too so could you
  14. talk about in your perspective some interesting let's say uses of artificial intelligence today in companies either
  15. by employees themselves or by firms and kind of the impact that you think it's having uh well in many respects you know
  16. when when did it all start or how long have we've been using it and and I think you actually have to go back to through
  17. decades where basically different kinds of artificial intelligence have basically been an integral part of
  18. companies forever I I remember I I like to say I was on the ground floor uh when
  19. I first started my career I was at car melon University and I used to play poker with some people from the computer
  20. science department and one of their complaints was that they had to go walk all the way down the hallway to get find
  21. out what was in the Coke machine because they would go down there and find out it
  22. was empty so basically they they they programmed one of the very first uh uses of FID technology to to program uh their
  23. uh the Coke machine so they could sit their computers and find out where uh uh whether it was empty or not it was worth
  24. the trip and so of course today there's you know how many Internet connected devices there are is like you know three
  25. times the world's population so it's basically been integrated throughout every single function of a business
  26. particularly in manufacturing consumer use and so forth and so forth um and so I I think some of the things that are
  27. happening today is we're shifting from uh artificial intelligence as a way of looking up information processing data
  28. to actually generating new knowledge and um uh and that's sort of like for and so
  29. one of the challenges I think for a lot of employees if you're saying advertising it I no longer going to be
  30. needed to generate um advertising copy when I can just throw it into chat GPT and it will generate the advertising so
  31. yeah I think one of the big areas that we've talked about on this series is what I say and I agree ai's been around
  32. for a long time as I was a PhD student almost 30 years ago is that predictive Ai and the use of AI to is as a data
  33. source whether it's computer vision sound Etc that's been around as you pointed out it's the generative AI part
  34. that's got people really excited today so Roger you actually have a company an actual company with i that does work in
  35. this area so could you elaborate on some specific areas where your organiz or your organization is implementing AI
  36. today yeah sure yeah initially we also started with like you said in predictive AI because in our platform people par
  37. their financial accounts information like their bank accounts credit cards Insurance retirement plans so we have
  38. lot of C structured data so we would use the data to improve our you experience and also help help our partners to sell
  39. their products But as time moves out you know we got unstructured data like voice
  40. image as you mentioned and the last few years it is the generative AI that came along it's quite interesting we launched
  41. a business called online financial literacy program about three years ago when people were locked down during the
  42. coid period when this live streaming e-commerce went on like crazy you know so we launched this uh online financial
  43. literacy and so far we have about three million people paid for our uh wealth management courses and it's very
  44. interesting uh the large language model and the GPD 3 I think they emerged about
  45. two years ago and we took notice it's not until last November when this chat GPT GPT 3.5 came along it hit us at the
  46. right time because back then we were Hing the right bottleneck of high we cannot hide our Shing assistant fast
  47. enough and train them fast enough then we turn on to the models you know uh generally AI helped quite a bit one it
  48. is the uh kind of help enhance the interactions by doing more C more uh kind of uh deeper and far
  49. reaching with automatic content generation so we develop an Robo ta and what it does is uh this traditional kind
  50. of instruction exercise quiz cycle it take aot with each individual student and when the test is done it will not tell
  51. the people that you know what you did wrong and help them to review the content the content is tor made
  52. individually on each knowledge point that they have missed so this PowerPoint is generated on the spot and the people
  53. can do it interactively until they click I understand button so it been very helpful and also we had daily financial
  54. news kind of analysis program and today I think more than 90% of the content is generated by this
  55. uh uh large length model generative AI our research analyst only to do a very brief review and then click on the
  56. publish button so it does help us quite a lot I think over 80% of interactions are performed by AI today rather than
  57. human being so Bob could you talk uh given you know the center you you run now well you're one of the co-directors
  58. of AI at Wharton um but it was also the Wharton impact of technology initiative um how do humans whether it's Learners
  59. as in the case Roger was talking about employees respondents in studies how do they tend to respond when they know
  60. something maybe they know we'll get to ro back to Roger in a second whether they know it's generated by uh an AI
  61. engine how do consumers tend to respond to the difference between the two yeah that's very interesting there's been uh
  62. increasing amount of work naturally on that I think one of the challenges of course right now there was a time when
  63. uh you you could tell whether or not something was you were interacting for for example in a a text interaction with
  64. a service person where you knew you were dealing with a robot and people didn't like that okay whereas now it's very
  65. very difficult to tell and sort of one of the issues in uh in like online advertising is deep fakes where
  66. basically you cannot tell the difference between it and so that sort of represents sort of an ethical issue and
  67. certainly as you might expect people don't like it when they think that they're being fooled and so that there's
  68. some evidence of that another area that we're looking into I have a colleague that's looking into is one of the things
  69. that the generative AI is doing is that it's synthesizing information and offering summaries and advice in task
  70. domains where you used to do it manually so for example um if you needed to know
  71. something about a topic you would go to Google and you would go through Bunches of sites and you were left to do the
  72. synthesis yourself and form your own conclusion now you could just go to whether it's Bing or chat GPT ask a
  73. question you know how do you do this what's your best advice for this and it'll take it will eventually do all
  74. that work for you synthesize it and give you an answer and what we're finding and
  75. it's it's sort of early in the process but basically people don't necessarily like that all that much in some sense
  76. it's a it's a thing where you feel that you have less ownership over it and so right now one of the biggest outstanding
  77. question is how much intelligence do people want okay and the the reality is is I guess just the same way that you
  78. don't necessarily necessarily um you know want to order all your meals out sometimes you want to cook them yourself
  79. in a lot of cases it could be there are going to be some domain where people are
  80. going to be more trusting and feel more ownership if they're Gathering the information themselves rather than
  81. having a computer do it even if it's the case with the computer uh advice is actually maybe a little bit better so
  82. Roger Bob's response is a perfect segue to my next question to you um as the president of a large company that's
  83. impacting millions of not only learners but also so investors people doing their
  84. private wealth management how do you decide what to kind of assign to the an AI engine whether it's an AI chatbot or
  85. an AI automatic grader or an AI person that gives or an AI engine that gives feedback and what do you leave to humans
  86. is it purely one of scale is it one of Finance H how do you think about what to assign to
  87. whom oh I think it's a in practice it's an emerging process process it's a gray scale kind of segmentation and we do
  88. have a lot of content uh generated by Ai and the people would know it's AI for example it's a Q&A session when they ask
  89. general question or AI ask question they answer they know they're dealing with AI
  90. that's kind of a level level one but level two we have people people would think they are
  91. interacting with a live person but actually this life person is largely assisted by the AI uh for the for
  92. example a piece of news analysis uh actually our research ANS are not that powerful of gathering so much
  93. information on time you know they are really empowered by the AI and and the highest level and we have people kind of
  94. upgrade to the ultimate level they become a a member they pay the membership fee for our advisory services
  95. and they would appreciate uh not only the assistant with AI so uh it definitely helps a lot but I don't think
  96. at this stage AI can completely replace human being even for know I the uh I have three followers and my company a
  97. digital version of R and didn't do that well I don't like it yet so I still try to publish my V
  98. uh in person so I think it's a it's a process emerging ongoing but you know looking back in less than year it has
  99. made tremendous progress yeah so Bob um building on Roger point and the point you made
  100. earlier how do you see you know we always try to say it's not humans or AI it's humans and AI how do you see that
  101. partnership evolving and also do you know you could imagine if I was an employee and I was being strategic if in
  102. some sense I prove to the company that AI can replace me that may not be great either so how do you see those two
  103. interacting well I think Roger spot on and saying the real challenge is is how do you figure what's their optimal blend
  104. like what are the things and uh we lastly in the um um a couple months ago we ran a uh generative AI conference out
  105. in San Francisco and uh some of one of the big topics there was trying to figure out uh such how good is BET The
  106. generative AI in generating creative Sol solutions to problems and um and it seems to be the case that the the in
  107. virging consensus is that what it does do is um is if people if you let uh say chat GPT work on a creative solution to
  108. a problem what it does is it it's much better at bringing up the low end of of human ability so basically if people who
  109. are not creative not good problem solvers you definitely want the machine stepping in because they do a much
  110. better job on the other hand what it does do do is it tends to um make Solutions seem very similar that it
  111. comes up with and basically there's the highend tale of people who there are people who are particularly skilled of
  112. problem solving and uh and in that case that what happen is you'll compare the the best of the human judgments and
  113. those tend to be better as judged by outside people uh than than Chachi PT solution so so the task is is that that
  114. you I think consistent with what Roger was talking about um you want to identify people within the organization
  115. who really do have these very special creativity skills and so forth and you want to let them free you know and maybe
  116. work work you know with tools but basically you don't want to replace that it's actually an interesting Theory
  117. which I'm sure people will test over time which is does this if you'd like AI engine actually inhibit creativity on
  118. the part of the humans it's why I always say you know the last thing I always tell this to PhD students and then Roger
  119. I have another question for you the last thing I do when I try to come up with a
  120. creative idea is when to read someone else's paper or synopsis paper because it does not help me come up with a
  121. creative idea at all um so Roger let me ask you um Robo advisory Services seems maybe to me a much higher Stakes type of
  122. decision than someone trying to learn financial literacy so how do you think I'll just use the language that we use
  123. in Academia all the time there's a very different loss function between an AI engine making some portfolio allocation
  124. or recommendation to me and then I go bankrupt as a result or you know I take some sort of literacy test and the AI
  125. engine kind of gets it wrong and I'm like all right well that's not great but it's not the end of the world how do you
  126. think about Bob was talking about let's called employee heterogenity how do you think about task importance heterogenity
  127. and the role of AI given high stakes versus low stakes types of decisions well this is a very important question
  128. you know uh I take the Global advisory is that high stake uh it's interesting this uh this uh this new phenomenon
  129. called generative AI tend to be sometimes very creative especially GPT you know sometimes it's imaginary uh
  130. well llama to tends to be more specific so in this uh Robo advisory has two sides oftion uh one side is the customer
  131. profiling custom the other side are the asset understanding asset Char Char istics so on the right hand side asset
  132. characteristics we want to be very careful with in terms of AI it's still classical AI you know classical uh
  133. statistics uh partial differential equation uh some sort of uh recursive neural network just understand uh
  134. understand the sigas the betas uh the gamas you know make sure that part differ frer are
  135. still there but the left hand side the customer needs uh the the life you know uh objectives can be very can be very
  136. suggestive because in the past the classical way uh doing this advisory Services is used to ask people about you
  137. know your personal asset liability income how many kids you have when are they going to school when they want to
  138. retire then come up with tailor Med Solutions but now with generative AI this can go a lot deeper uh you can
  139. having conversations about life objectives one is of course retirement you also have example your wedding
  140. anniversary but then in the The Advisory who are wedding anniversary the risk profile appetite could be very different
  141. from a kind of 20-year retirement plan so for wedding anniversary if you take on risk like play with derivatives or on
  142. Leverage trading if it works well you know you go on skiing in Switzerland if it does not work you always have you
  143. know Disneyland in Florida so I think with the help of AI this can go a lot deeper a lot more creative inactive and
  144. also gim finish me meanwhile still holds the seriousness of financial advisory so
  145. I think it definitely add value you need to understand where to use them kind of
  146. uh correctly in the in the Prudence fashion yeah Roger I have a question for you uh do you ever worry a little bit
  147. that as um particularly in the context of financial advising that the uh the tool becomes so good that P maybe put
  148. too much trust in it um so for example if you're dealing with a human advisor you know you're dealing with a human and
  149. you know that humans are are fallible and so if the human advisor basically tells you this is what you should be
  150. doing with your money this is what you should retirement you'll follow that advice but basically with u um which you
  151. know it's potentially somewhat fallible but on the other hand if if you have a u
  152. a very Advanced um computer tool which is uh and you you sell it as being you know optimized based on whatever uh is
  153. there a worry that people would become then go the other extreme of being too trusting of it well but I'm not worried
  154. this part actually people believe what they believe they can believe a real person they can believe into an
  155. algorithm which is also humanized have content generation if the results is good and they believe into it so the
  156. beauty here is you don't have one key opinion leader you have dozens you know because even different AI have different
  157. right characteristics people have my value based I'm my gross based so and it's fun what I do worry is actually on
  158. the regular regulatory pieces because you know generally like I said before tend to be more creative so but there
  159. are rules and regulations what you can say what you cannot say for example uh with certain uh kind of uh licenses
  160. you're not allowed to recommend individual stocks or maybe you are not allowed to recommend something to people
  161. not at this risk rate so this part you got to be very careful if you ever cross a line it is actually the companies the
  162. people behind those this AI are holding held responsible so I want to be very careful about that but unfortunately uh
  163. the lines are not very clear given from The Regulators because it's a new thing for them as well so Bob you and I are
  164. both obviously marketing professors um you had mentioned about let's call it ad creation as one area what do you see and
  165. then I'm going to ask Roger about his area in fintech but what do you see as the major application areas that you see
  166. not just us as academic studying but that you see AI is going to be used in our home field of marketing well I think
  167. you had mentioned the case of usually when people say how there's two different cases of it okay certainly s
  168. of predictive AI that's been around forever and product design so forth um uh and and certainly in the case of
  169. every time you go to Amazon you're seeing AI okay you're basically seeing products recommended for you and that's
  170. been around for for for for a while so presumably they'll see improvements on that you're going to be seeing um uh
  171. better customizations when you go there you go wow how did it know that's exactly what I wanted and some people
  172. might find that scary but other people might find that's exactly sort of the product I want uh the other side in
  173. terms of the creativity part that's sort of a little bit we don't quite know yet
  174. um in terms of whether or not if we Fally U fully turn over all of um the creative process and advertising design
  175. creative process and strategy formulation uh po the potential is certainly there for example with u large
  176. language models and general generative AI at whole to basically generate all of this now whether or not that's end up
  177. going to be the type of thing which is going to generate uh that outof the-box type of AD Campaign which really makes
  178. the difference for a company as opposed to whether or not it makes it generates a whole bunch of advertising which is
  179. all the same okay so effectively it's just sort of you know govering the Mass rather than the tail and usually we like
  180. to focus more on that that breakthrough creative idea and I'm not so sure they've conver very much out whether or
  181. not um generative AI can produce that kind of a breakthrough and Roger how about in fintech what do you see as the
  182. biggest uses of AI today well we just follow on what you guys were discussing about in marketing I think uh I'm
  183. actually very optimistic just like help to discover new you know DNA patterns new drugs and also in ALA go you know AI
  184. discovered new ways of playing go and in this marketing especially in the fintech
  185. area every months we spend the tens of millions uh into those the we call you know uh information on Tik Tok or
  186. equivalent to kind of Google app kind of on on those sides so every week or every
  187. point of time usually we have hands if we call marketing plan don't and which one's are going to stick you don't know
  188. but with generative AI you can create those creatives uh very easily it's like it
  189. disperse different patterns you the way figure out the dnas from those marketing
  190. plans maybe it is you know the way you bring up a a pet versus a young boy you know maybe maybe it is the feeling of a
  191. retirement age something like that but the underlying I call DNA of marketing materials now can be S of tried and Ed
  192. and discovered very wild and in this whole Space of digital marketing I think it takes to the next level so I think
  193. that's on the one hand because every company needs toire customers and manage customer experience I think AI could
  194. help lot uh I think what furthermore because this chat gbt uh this Genera AI a large language model usually it's not
  195. as good as sort of doing new numerical calculations but now with this plugins you can actually combine you know those
  196. tools with the traditional Ai and actually even on the asset management side I can see new kind of AI powered
  197. kind of trading algorith is very different from the traditional ones and competing on part with the uh uh the
  198. kind of traditional hedge funds uh programs so I think uh it's a big thing it's coming and only we right now only
  199. scratching the surface so we only have about a minute left so Bob maybe in 30 seconds or so um if we're sitting here
  200. 10 years from now what have we been talking about what are we going to be talking about that's happened over the
  201. last 10 years that's an awesome question I have no idea whatsoever and and I think that in it's it's from my
  202. perspective as a researcher this is like uh the most exciting time to be alive because basically what we're in the
  203. precipice of is just really very fundamental Transformations as to uh how people get information how people
  204. generate information and we're just beginning to understand how this is affecting society and so to me there's
  205. just so much to that we have to learn as researchers going forward so it's an awesome time to be here and Roger from
  206. your point of view um how do you think about the business World investing what do you think are going to be the big
  207. breakthrough issues in AI in the next few years well I think companies have to figure out their position this big AI
  208. game you know it's like a big tree right you have open AI Google those guys are the roots right and you have maybe uh F
  209. Tech players like us there are this industry specific applications they are like a Trunks and there are many many Le
  210. applications so I think uh either you are a young entrepreneur right into the game or whether you are established
  211. company I think it's very important understand that Financial uh the technology Trends and figuring out your
  212. position in your field I think know keeping an open mind would be very very helpful and uh things change and we got
  213. adap well this is Eric bradow professor of marketing and statistics here at the Wharton School and also Vice Jean of
  214. analytics I'd like to thank my two guests my colleague and friend Bob Meyer the Frederick H Ecker Met Life Insurance
  215. professor and also one of our co-directors of our Center on artificial intelligence and and I'd also like
  216. to thank Roger goo who's the co-founder and president of aai a prominent independent mobile based platform for
  217. personal Wealth Management in China and as I also mentioned one of our valued board members at analytics at Wharton so
  218. Bob and Roger thank you for joining us today thank you very much

Brief Summary

Bob Meyer and Roger Goo discuss AI's impact on business, ethics, and the future of marketing and finance.

Key points

  • AI in Action. The podcast features discussions on the applications of AI in business and marketing.
  • Generative AI's Impact. Bob and Roger explore the transformative effects of generative AI on industries.
  • AI vs Human Creativity. The conversation delves into the balance between AI assistance and human creativity in problem-solving.
  • The Future of AI in Business. Experts discuss the transformative potential of AI in various industries, emphasizing the need for companies to adapt.

Tension

45/ 100Some tension

Related episodes