What Impact Will AI Have on Organizations? – Bob Meyer & Roger Gu | AI in Focus Series
Ask about Knowledge at Wharton
Episode Description
EPISODE OVERVIEW Wharton professor and Faculty Co-Director or AI at Wharton Bob Meyer and Wacai co-founder and president Roger Gu join Eric Bradlow, vice dean of Analytics at Wharton, to discuss how AI is changing industries and organizations, touching on real-life applications like robo-advisors, customer engagement, marketing, and more. This interview is part of a special 10-part series called "AI in Focus."
Topics and questions covered: 00:00 - Introductions 1:15 - Examining AI's potential applications 3:36 - Exploring AI uses at Wacai 6:45 - Analyzing consumer reactions to AI 9:19 - Wacai President Gu's strategy for AI delegation 13:41 - Assessing task importance heterogeneity 17:31 - Could humans trust AI too much? 19:57 - AI applications in FinTech and marketing 24:22 - Potential frontiers of AI
SERIES OVERVIEW The artificial intelligence revolution is officially upon us. Hear from host Eric Bradlow, Vice Dean of Analytics at Wharton, as he meets with Wharton faculty experts across a wide range of business domains – from healthcare and neuroscience to sports and the auto industry – to learn how AI will impact these fields moving forward, and what we can do to stay ahead of the curve.
----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.
Launched in 1999, Knowledge at Wharton offers free access to:
- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox
Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU 📂 Technology;AI 🏷️ Research;AI in Focus
Read the full transcriptHide the full transcript
- welcome to the next installment of the analytics at Wharton series focused on artificial intelligence I'm Eric bradow
- professor of marketing and statistics here at the Wharton School and I'm also Vice dean of analytics at Wharton we
- think one of the important applications and areas that we as a business school should focus on is what we're calling
- today's session AI in action and I can think of no two better people to speak to us about this than number one my
- colleague Bob Meyer who will be joining us Bob is the Frederick H eer bet life insurance Professor he's also the
- co-director of the Wharton impact of technology initiative so first Bob uh Welcome to our podcast welcome it's good
- good to be here and then second um is Mr Roger Goo uh Roger is the co-founder and
- president of Wai a prominent independent mobile based platform for comprehensive
- Wealth Management in China uh Rogers got a career spanning multiple decades both
- in the United States and in China he also serves and I'm very proud to have Roger both as a friend but as a valued
- member of the analytics at Wharton Advisory board so Roger Welcome to our podcast well thanks for having pleasure
- so Bob let me start with you um you do a lot of work on the impact of technology
- let's call it broadly defined on human behavior so could you all and of course employees are humans too so could you
- talk about in your perspective some interesting let's say uses of artificial intelligence today in companies either
- by employees themselves or by firms and kind of the impact that you think it's having uh well in many respects you know
- when when did it all start or how long have we've been using it and and I think you actually have to go back to through
- decades where basically different kinds of artificial intelligence have basically been an integral part of
- companies forever I I remember I I like to say I was on the ground floor uh when
- I first started my career I was at car melon University and I used to play poker with some people from the computer
- science department and one of their complaints was that they had to go walk all the way down the hallway to get find
- out what was in the Coke machine because they would go down there and find out it
- was empty so basically they they they programmed one of the very first uh uses of FID technology to to program uh their
- uh the Coke machine so they could sit their computers and find out where uh uh whether it was empty or not it was worth
- the trip and so of course today there's you know how many Internet connected devices there are is like you know three
- times the world's population so it's basically been integrated throughout every single function of a business
- particularly in manufacturing consumer use and so forth and so forth um and so I I think some of the things that are
- happening today is we're shifting from uh artificial intelligence as a way of looking up information processing data
- to actually generating new knowledge and um uh and that's sort of like for and so
- one of the challenges I think for a lot of employees if you're saying advertising it I no longer going to be
- needed to generate um advertising copy when I can just throw it into chat GPT and it will generate the advertising so
- yeah I think one of the big areas that we've talked about on this series is what I say and I agree ai's been around
- for a long time as I was a PhD student almost 30 years ago is that predictive Ai and the use of AI to is as a data
- source whether it's computer vision sound Etc that's been around as you pointed out it's the generative AI part
- that's got people really excited today so Roger you actually have a company an actual company with i that does work in
- this area so could you elaborate on some specific areas where your organiz or your organization is implementing AI
- today yeah sure yeah initially we also started with like you said in predictive AI because in our platform people par
- their financial accounts information like their bank accounts credit cards Insurance retirement plans so we have
- lot of C structured data so we would use the data to improve our you experience and also help help our partners to sell
- their products But as time moves out you know we got unstructured data like voice
- image as you mentioned and the last few years it is the generative AI that came along it's quite interesting we launched
- a business called online financial literacy program about three years ago when people were locked down during the
- coid period when this live streaming e-commerce went on like crazy you know so we launched this uh online financial
- literacy and so far we have about three million people paid for our uh wealth management courses and it's very
- interesting uh the large language model and the GPD 3 I think they emerged about
- two years ago and we took notice it's not until last November when this chat GPT GPT 3.5 came along it hit us at the
- right time because back then we were Hing the right bottleneck of high we cannot hide our Shing assistant fast
- enough and train them fast enough then we turn on to the models you know uh generally AI helped quite a bit one it
- is the uh kind of help enhance the interactions by doing more C more uh kind of uh deeper and far
- reaching with automatic content generation so we develop an Robo ta and what it does is uh this traditional kind
- of instruction exercise quiz cycle it take aot with each individual student and when the test is done it will not tell
- the people that you know what you did wrong and help them to review the content the content is tor made
- individually on each knowledge point that they have missed so this PowerPoint is generated on the spot and the people
- can do it interactively until they click I understand button so it been very helpful and also we had daily financial
- news kind of analysis program and today I think more than 90% of the content is generated by this
- uh uh large length model generative AI our research analyst only to do a very brief review and then click on the
- publish button so it does help us quite a lot I think over 80% of interactions are performed by AI today rather than
- human being so Bob could you talk uh given you know the center you you run now well you're one of the co-directors
- of AI at Wharton um but it was also the Wharton impact of technology initiative um how do humans whether it's Learners
- as in the case Roger was talking about employees respondents in studies how do they tend to respond when they know
- something maybe they know we'll get to ro back to Roger in a second whether they know it's generated by uh an AI
- engine how do consumers tend to respond to the difference between the two yeah that's very interesting there's been uh
- increasing amount of work naturally on that I think one of the challenges of course right now there was a time when
- uh you you could tell whether or not something was you were interacting for for example in a a text interaction with
- a service person where you knew you were dealing with a robot and people didn't like that okay whereas now it's very
- very difficult to tell and sort of one of the issues in uh in like online advertising is deep fakes where
- basically you cannot tell the difference between it and so that sort of represents sort of an ethical issue and
- certainly as you might expect people don't like it when they think that they're being fooled and so that there's
- some evidence of that another area that we're looking into I have a colleague that's looking into is one of the things
- that the generative AI is doing is that it's synthesizing information and offering summaries and advice in task
- domains where you used to do it manually so for example um if you needed to know
- something about a topic you would go to Google and you would go through Bunches of sites and you were left to do the
- synthesis yourself and form your own conclusion now you could just go to whether it's Bing or chat GPT ask a
- question you know how do you do this what's your best advice for this and it'll take it will eventually do all
- that work for you synthesize it and give you an answer and what we're finding and
- it's it's sort of early in the process but basically people don't necessarily like that all that much in some sense
- it's a it's a thing where you feel that you have less ownership over it and so right now one of the biggest outstanding
- question is how much intelligence do people want okay and the the reality is is I guess just the same way that you
- don't necessarily necessarily um you know want to order all your meals out sometimes you want to cook them yourself
- in a lot of cases it could be there are going to be some domain where people are
- going to be more trusting and feel more ownership if they're Gathering the information themselves rather than
- having a computer do it even if it's the case with the computer uh advice is actually maybe a little bit better so
- Roger Bob's response is a perfect segue to my next question to you um as the president of a large company that's
- impacting millions of not only learners but also so investors people doing their
- private wealth management how do you decide what to kind of assign to the an AI engine whether it's an AI chatbot or
- an AI automatic grader or an AI person that gives or an AI engine that gives feedback and what do you leave to humans
- is it purely one of scale is it one of Finance H how do you think about what to assign to
- whom oh I think it's a in practice it's an emerging process process it's a gray scale kind of segmentation and we do
- have a lot of content uh generated by Ai and the people would know it's AI for example it's a Q&A session when they ask
- general question or AI ask question they answer they know they're dealing with AI
- that's kind of a level level one but level two we have people people would think they are
- interacting with a live person but actually this life person is largely assisted by the AI uh for the for
- example a piece of news analysis uh actually our research ANS are not that powerful of gathering so much
- information on time you know they are really empowered by the AI and and the highest level and we have people kind of
- upgrade to the ultimate level they become a a member they pay the membership fee for our advisory services
- and they would appreciate uh not only the assistant with AI so uh it definitely helps a lot but I don't think
- at this stage AI can completely replace human being even for know I the uh I have three followers and my company a
- digital version of R and didn't do that well I don't like it yet so I still try to publish my V
- uh in person so I think it's a it's a process emerging ongoing but you know looking back in less than year it has
- made tremendous progress yeah so Bob um building on Roger point and the point you made
- earlier how do you see you know we always try to say it's not humans or AI it's humans and AI how do you see that
- partnership evolving and also do you know you could imagine if I was an employee and I was being strategic if in
- some sense I prove to the company that AI can replace me that may not be great either so how do you see those two
- interacting well I think Roger spot on and saying the real challenge is is how do you figure what's their optimal blend
- like what are the things and uh we lastly in the um um a couple months ago we ran a uh generative AI conference out
- in San Francisco and uh some of one of the big topics there was trying to figure out uh such how good is BET The
- generative AI in generating creative Sol solutions to problems and um and it seems to be the case that the the in
- virging consensus is that what it does do is um is if people if you let uh say chat GPT work on a creative solution to
- a problem what it does is it it's much better at bringing up the low end of of human ability so basically if people who
- are not creative not good problem solvers you definitely want the machine stepping in because they do a much
- better job on the other hand what it does do do is it tends to um make Solutions seem very similar that it
- comes up with and basically there's the highend tale of people who there are people who are particularly skilled of
- problem solving and uh and in that case that what happen is you'll compare the the best of the human judgments and
- those tend to be better as judged by outside people uh than than Chachi PT solution so so the task is is that that
- you I think consistent with what Roger was talking about um you want to identify people within the organization
- who really do have these very special creativity skills and so forth and you want to let them free you know and maybe
- work work you know with tools but basically you don't want to replace that it's actually an interesting Theory
- which I'm sure people will test over time which is does this if you'd like AI engine actually inhibit creativity on
- the part of the humans it's why I always say you know the last thing I always tell this to PhD students and then Roger
- I have another question for you the last thing I do when I try to come up with a
- creative idea is when to read someone else's paper or synopsis paper because it does not help me come up with a
- creative idea at all um so Roger let me ask you um Robo advisory Services seems maybe to me a much higher Stakes type of
- decision than someone trying to learn financial literacy so how do you think I'll just use the language that we use
- in Academia all the time there's a very different loss function between an AI engine making some portfolio allocation
- or recommendation to me and then I go bankrupt as a result or you know I take some sort of literacy test and the AI
- engine kind of gets it wrong and I'm like all right well that's not great but it's not the end of the world how do you
- think about Bob was talking about let's called employee heterogenity how do you think about task importance heterogenity
- and the role of AI given high stakes versus low stakes types of decisions well this is a very important question
- you know uh I take the Global advisory is that high stake uh it's interesting this uh this uh this new phenomenon
- called generative AI tend to be sometimes very creative especially GPT you know sometimes it's imaginary uh
- well llama to tends to be more specific so in this uh Robo advisory has two sides oftion uh one side is the customer
- profiling custom the other side are the asset understanding asset Char Char istics so on the right hand side asset
- characteristics we want to be very careful with in terms of AI it's still classical AI you know classical uh
- statistics uh partial differential equation uh some sort of uh recursive neural network just understand uh
- understand the sigas the betas uh the gamas you know make sure that part differ frer are
- still there but the left hand side the customer needs uh the the life you know uh objectives can be very can be very
- suggestive because in the past the classical way uh doing this advisory Services is used to ask people about you
- know your personal asset liability income how many kids you have when are they going to school when they want to
- retire then come up with tailor Med Solutions but now with generative AI this can go a lot deeper uh you can
- having conversations about life objectives one is of course retirement you also have example your wedding
- anniversary but then in the The Advisory who are wedding anniversary the risk profile appetite could be very different
- from a kind of 20-year retirement plan so for wedding anniversary if you take on risk like play with derivatives or on
- Leverage trading if it works well you know you go on skiing in Switzerland if it does not work you always have you
- know Disneyland in Florida so I think with the help of AI this can go a lot deeper a lot more creative inactive and
- also gim finish me meanwhile still holds the seriousness of financial advisory so
- I think it definitely add value you need to understand where to use them kind of
- uh correctly in the in the Prudence fashion yeah Roger I have a question for you uh do you ever worry a little bit
- that as um particularly in the context of financial advising that the uh the tool becomes so good that P maybe put
- too much trust in it um so for example if you're dealing with a human advisor you know you're dealing with a human and
- you know that humans are are fallible and so if the human advisor basically tells you this is what you should be
- doing with your money this is what you should retirement you'll follow that advice but basically with u um which you
- know it's potentially somewhat fallible but on the other hand if if you have a u
- a very Advanced um computer tool which is uh and you you sell it as being you know optimized based on whatever uh is
- there a worry that people would become then go the other extreme of being too trusting of it well but I'm not worried
- this part actually people believe what they believe they can believe a real person they can believe into an
- algorithm which is also humanized have content generation if the results is good and they believe into it so the
- beauty here is you don't have one key opinion leader you have dozens you know because even different AI have different
- right characteristics people have my value based I'm my gross based so and it's fun what I do worry is actually on
- the regular regulatory pieces because you know generally like I said before tend to be more creative so but there
- are rules and regulations what you can say what you cannot say for example uh with certain uh kind of uh licenses
- you're not allowed to recommend individual stocks or maybe you are not allowed to recommend something to people
- not at this risk rate so this part you got to be very careful if you ever cross a line it is actually the companies the
- people behind those this AI are holding held responsible so I want to be very careful about that but unfortunately uh
- the lines are not very clear given from The Regulators because it's a new thing for them as well so Bob you and I are
- both obviously marketing professors um you had mentioned about let's call it ad creation as one area what do you see and
- then I'm going to ask Roger about his area in fintech but what do you see as the major application areas that you see
- not just us as academic studying but that you see AI is going to be used in our home field of marketing well I think
- you had mentioned the case of usually when people say how there's two different cases of it okay certainly s
- of predictive AI that's been around forever and product design so forth um uh and and certainly in the case of
- every time you go to Amazon you're seeing AI okay you're basically seeing products recommended for you and that's
- been around for for for for a while so presumably they'll see improvements on that you're going to be seeing um uh
- better customizations when you go there you go wow how did it know that's exactly what I wanted and some people
- might find that scary but other people might find that's exactly sort of the product I want uh the other side in
- terms of the creativity part that's sort of a little bit we don't quite know yet
- um in terms of whether or not if we Fally U fully turn over all of um the creative process and advertising design
- creative process and strategy formulation uh po the potential is certainly there for example with u large
- language models and general generative AI at whole to basically generate all of this now whether or not that's end up
- going to be the type of thing which is going to generate uh that outof the-box type of AD Campaign which really makes
- the difference for a company as opposed to whether or not it makes it generates a whole bunch of advertising which is
- all the same okay so effectively it's just sort of you know govering the Mass rather than the tail and usually we like
- to focus more on that that breakthrough creative idea and I'm not so sure they've conver very much out whether or
- not um generative AI can produce that kind of a breakthrough and Roger how about in fintech what do you see as the
- biggest uses of AI today well we just follow on what you guys were discussing about in marketing I think uh I'm
- actually very optimistic just like help to discover new you know DNA patterns new drugs and also in ALA go you know AI
- discovered new ways of playing go and in this marketing especially in the fintech
- area every months we spend the tens of millions uh into those the we call you know uh information on Tik Tok or
- equivalent to kind of Google app kind of on on those sides so every week or every
- point of time usually we have hands if we call marketing plan don't and which one's are going to stick you don't know
- but with generative AI you can create those creatives uh very easily it's like it
- disperse different patterns you the way figure out the dnas from those marketing
- plans maybe it is you know the way you bring up a a pet versus a young boy you know maybe maybe it is the feeling of a
- retirement age something like that but the underlying I call DNA of marketing materials now can be S of tried and Ed
- and discovered very wild and in this whole Space of digital marketing I think it takes to the next level so I think
- that's on the one hand because every company needs toire customers and manage customer experience I think AI could
- help lot uh I think what furthermore because this chat gbt uh this Genera AI a large language model usually it's not
- as good as sort of doing new numerical calculations but now with this plugins you can actually combine you know those
- tools with the traditional Ai and actually even on the asset management side I can see new kind of AI powered
- kind of trading algorith is very different from the traditional ones and competing on part with the uh uh the
- kind of traditional hedge funds uh programs so I think uh it's a big thing it's coming and only we right now only
- scratching the surface so we only have about a minute left so Bob maybe in 30 seconds or so um if we're sitting here
- 10 years from now what have we been talking about what are we going to be talking about that's happened over the
- last 10 years that's an awesome question I have no idea whatsoever and and I think that in it's it's from my
- perspective as a researcher this is like uh the most exciting time to be alive because basically what we're in the
- precipice of is just really very fundamental Transformations as to uh how people get information how people
- generate information and we're just beginning to understand how this is affecting society and so to me there's
- just so much to that we have to learn as researchers going forward so it's an awesome time to be here and Roger from
- your point of view um how do you think about the business World investing what do you think are going to be the big
- breakthrough issues in AI in the next few years well I think companies have to figure out their position this big AI
- game you know it's like a big tree right you have open AI Google those guys are the roots right and you have maybe uh F
- Tech players like us there are this industry specific applications they are like a Trunks and there are many many Le
- applications so I think uh either you are a young entrepreneur right into the game or whether you are established
- company I think it's very important understand that Financial uh the technology Trends and figuring out your
- position in your field I think know keeping an open mind would be very very helpful and uh things change and we got
- adap well this is Eric bradow professor of marketing and statistics here at the Wharton School and also Vice Jean of
- analytics I'd like to thank my two guests my colleague and friend Bob Meyer the Frederick H Ecker Met Life Insurance
- professor and also one of our co-directors of our Center on artificial intelligence and and I'd also like
- to thank Roger goo who's the co-founder and president of aai a prominent independent mobile based platform for
- personal Wealth Management in China and as I also mentioned one of our valued board members at analytics at Wharton so
- Bob and Roger thank you for joining us today thank you very much
Brief Summary
Bob Meyer and Roger Goo discuss AI's impact on business, ethics, and the future of marketing and finance.
Key points
- AI in Action. The podcast features discussions on the applications of AI in business and marketing.
- Generative AI's Impact. Bob and Roger explore the transformative effects of generative AI on industries.
- AI vs Human Creativity. The conversation delves into the balance between AI assistance and human creativity in problem-solving.
- The Future of AI in Business. Experts discuss the transformative potential of AI in various industries, emphasizing the need for companies to adapt.
Episode highlights
- AI in ActionThe podcast features discussions on the applications of AI in business and marketing.“We think one of the important applications is AI in action.”0:20Nov 10, 2023
- Generative AI's ImpactBob and Roger explore the transformative effects of generative AI on industries.“Generative AI is what’s got people really excited today.”3:34Nov 10, 2023
- AI vs Human CreativityThe conversation delves into the balance between AI assistance and human creativity in problem-solving.“It’s humans and AI, not humans or AI.”11:49Nov 10, 2023
- The Future of AI in BusinessExperts discuss the transformative potential of AI in various industries, emphasizing the need for companies to adapt.“Companies have to figure out their position in this big AI game.”25:06Nov 10, 2023





