Decision-Driven Analytics in the Era of AI

Knowledge at Wharton

Ask about Knowledge at Wharton

Episode Description

EPISODE OVERVIEW Rather than mining data for insights, companies need to think more strategically about the decisions they need to make, and use data to help them get there. Wharton’s Stefano Puntoni says that’s the focus of his new book, “Decision-driven Analytics.”

PODCAST OVERVIEW Every day, business scholars answer pressing questions in their research - but what do their insights mean for you? In this podcast, Wharton faculty dive into what inspired their studies and how their findings resonate with the world today. Learn how research insights translate into knowledge you can use, with host Dan Loney.

Learn more at http://whr.tn/rippleeffect.

#analytics #AI #decisionmaking #leadership ----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.

Launched in 1999, Knowledge at Wharton offers free access to:

- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox

Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU

Read the full transcriptHide the full transcript
  1. Stefano Puntoni: But in many situations, we do have lots and lots of data. The problem is sometimes those data are not the data you
  2. need, or maybe those data are not being thought of the right way in terms of supporting the decisions that are important to make.
  3. Dan Loney: But I guess there is an importance that we need to kind of reinstall, in
  4. many cases, on the human component of this entire process. - Yeah, the human judgment is crucial. So actually, what I
  5. argue always is that as computers and algorithms become smarter and smarter, and the data becomes better and better, we
  6. should think harder, not less. And so in a way, the key message of the book almost is to say -- Dan Loney: And welcome to
  7. a special edition of Ripple Effect: Meet the Authors. I'm your host, Dan Loney. In each episode this month, the podcast
  8. will feature Wharton faculty authors in lively, fast moving conversations about their latest books and research. We're going
  9. to be covering a diverse range of topics, bringing you the latest insights and knowledge that you can apply to your life
  10. and to work. And hello, and welcome to the Ripple Effect: Meet the Author series. I'm your host the Dan Loney. Today we're
  11. talking with Stefano Puntoni about his book, <i>Decision-Driven</i> <i>Analytics</i>. Stefano's book is about leveraging human
  12. intelligence to unlock the power of data. And the book offers a new approach about making good decisions with data. Stefano,
  13. great to see you again. Thanks very much for your time today. And I guess let's start out with just explaining how you view, or
  14. what your definition of decision- driven analytics is. - Thanks, Dan, for having me. And I'm excited to be here and tell you
  15. a little bit about our new book. And the book is motivated by the problems that we see in many companies where analytics are
  16. complex. Companies have invested heavily. We have lots of data. And yet companies sometimes seem to struggle to extract value
  17. from that data. And what we argue in the book, basically, is that the gold standard that many companies have set themselves on,
  18. which is data-driven decision making, may to some extent, actually get the point wrong, meaning perhaps we argue
  19. it shouldn't be the decision making that is data driven. Instead, we argue it should be the data analytics that is
  20. decision driven, meaning rather than focusing on the data, and then trying to figure out how do we extract value to improve
  21. our decision making, it might be much better, in fact in many situations, to do the opposite. And say, let's start from the
  22. decisions that we need to make and figure out what data we need to make those decisions.
  23. - What kind of potential impact then have we maybe you've been looking at because -- that maybe the process hasn't
  24. been exactly the way that it should be and we're maybe not extracting the value that we really should? - The
  25. idea of data-driven decision making is not -- nobody argues that using data to make decisions is a bad idea. We need data to make
  26. good decisions. What we argue in the book is that the emphasis is wrong. And that, you know, the complexity and investments
  27. required to get the data systems in place, and all that work that has to be done, complex, technical, have attracted a lot
  28. of attention. And at some point, people end up in a situation where looking at data and trying to find a purpose for it, rather
  29. than looking at the questions that they need to answer and find data for that purpose.
  30. - Are there common mistakes that end up popping up as you've kind of investigated this by not going more of a data-driven
  31. perspective? - Yes, so the mistakes that we see companies do are basically of a variety of types. But the two that are very common are that
  32. companies sometimes end up answering the wrong questions, because they haven't connected the analytics to the decisions
  33. that they need to make very well. And because of that, they explore stuff that is actually not the stuff they should be
  34. exploring. And the second is that by focusing so much on the data, you almost end up putting this data on a pedestal and
  35. glorifying them to the extent where you might actually become uncritical of them, and not understanding what are the
  36. pitfalls that you might run into if you make decisions based on this data. And so the basic issue is actually that of a
  37. disconnect between decision making and data analytics, where there is this large gap between the people, the
  38. leaders who make the decisions, and the systems that are meant to support them. - I guess it's important to ask these questions right now,
  39. because it feels like we have more data than ever. And in many cases, I would assume the decision makers are probably
  40. inundated with this data, and maybe don't know how to parse through it and make the right call.
  41. - Yeah, it's like a strange irony in that for a long time companies were complaining they don't have data to make decisions. Now
  42. they're still complaining about data, but now they complain, oftentimes, you know, they have too much data, meaning that
  43. there's so many things that one could look at and it's a bit -- it's easy to get lost. Of course, we still have many
  44. situations where we don't have good data. And companies still are struggling to figure out ways in which they can achieve,
  45. you know, kind of evidence-based decision making in those situations. And I think we need to keep looking for great data
  46. there. But in many situations, we do have lots and lots of data. The problem is that sometimes those data are not the
  47. data you need, or maybe those data are not being thought of the right way in terms of supporting the decisions that
  48. are important to make. - But I guess there is an importance that we need to kind of
  49. reinstall, in many cases, on the human component of this entire process. - Yeah, the human judgment is crucial. So actually, what I
  50. argue always is that as computers and algorithms become smarter and smarter, and the data becomes better and better,
  51. we should think harder, not less. And so in a way, the key message of the book almost is to say that the secret to making
  52. good decisions with data is that before you even start looking at the data, you need to do a lot of thinking. So it takes a lot
  53. of thinking without data to make good decisions with data. - So we're now in a time where artificial intelligence is
  54. playing a bigger and bigger role in a lot of things that we do. How potentially does AI kind of impact the decision process and
  55. either make it better or worse, depending on all of this data that we have now in the mix? - Yeah,
  56. AI is the biggest thing happening today. And I'm very excited about all the work that the Wharton School is doing in
  57. the area of AI. In fact, our Dean, Erika James, just yesterday announced a major new initiative called the Wharton Initiative for
  58. AI and Analytics. And we're basically really pushing hard on what we know and what we can do to support business decision
  59. making. But AI here, as I think both, you know, a risk and an enormous upside potential, in that the risk is as we use more
  60. and more complex algorithms and technology, that gap that I mentioned earlier between decision making and the analyst
  61. is only risking to grow even larger, because now basically the decision makers have even a looser grasp of what these
  62. techniques can do and what they are about. And the people who are technical become so technical, they now lack, you
  63. know, a link to the business and maybe domain expertise that can help them be good partners for the leaders who are making
  64. decisions. So that's the risk part. But the upside potential is enormous. I think we are going to benefit in a million
  65. different ways from AI to improve our decision making, by automating decisions in a much smarter way, by providing tools
  66. that can help support human expert's decisions, and making sure that the scarce expertise of our human professionals is used
  67. for the cases where that expertise can really move the needle, and leave the rest to AI. - And
  68. the goal is still the same from the company's perspective. They're looking for the best outcome they can, you know,
  69. create, but you're going about it in a much more advanced way with all of these different components kind of in the mix
  70. now. - Yeah, for sure. AI is not going to tell you what you want, and what you should want. AI is going to just help you get
  71. there. So we still need the leadership, we still need human expertise and creativity, imagination to think about what
  72. the future might look like. - Does that then kind of take us into the discussion a little bit about
  73. what AI is going to mean for companies moving forward? Obviously, there's a lot of discussion about AI replacing
  74. humans. But it seems like more and more, a lot of people are coming around to the fact that AI will be complementary to
  75. humans. - It will be both them. But I think that a lot of the conversations around AI have this tone of human replacement,
  76. human or AI. Can we develop AI systems that emulate human capabilities? And the assumption of doing that, essentially, is
  77. to say, well, once we have the AI system that can do what the human does, maybe we don't need a human anymore. And I argue
  78. that business schools can play an important role to complement that perspective with a different one, which is what
  79. kinds of AI systems do we need to complement and augment human experience and human expertise? So instead of thinking about
  80. human or AI, can we think about human and AI? For example, we just started a course here. I'm teaching a course at Wharton
  81. called "AI In Our Lives." And the whole point is exactly to do that and think about, what can AI do, and how do we benefit from
  82. that? And then what is it that humans do incredibly well, and how do we design an AI system to support that?
  83. - I would imagine that when you look at the component of the decision process that will go on, you're talking about
  84. things that can impact top to bottom, up and down the corporate ladder in terms of all kinds of different decisions that may
  85. come into play. - Yeah, of course. In different functions, at different levels in the organization. And, you know, one point that we make in
  86. the book is that every decision making -- maker needs to consider what decisions are mine to make, and not worry about those are
  87. not yours to make. And of course, you can lobby, you can try to influence and bring, you know, issues to the table for
  88. those who make those decisions. But you should primarily focus on the decision you need to make and then find out how technology
  89. and data can help you making those decisions. - One of the other areas you talk about in the book are the
  90. decisions that end up having an impact either in the area of costs or the area of benefits. And I guess there's a dynamic of
  91. how that decision process will end up impacting the thought of the investment that a company may make, but obviously, the
  92. longer term benefit along the way as well. - Right, and that stems from the vision of the leadership, of
  93. course, what it is that we're trying to pursue. I think AI is one of those technologies, and analytics more broadly, that
  94. enables companies to think in different ways about the benefit that it can reap. Some of it might be efficiency. So it could be
  95. mostly a matter of making things smoother, better, reducing risks, and reducing costs, and managing things that way. But there is
  96. also a different way of thinking of it, and say how do we make things better and more effective? And perhaps not just
  97. say, how do we do what we do now better, but to think bigger and think about what is it that we are not currently doing that we
  98. could be doing. And that I think is the real potential of of data and AI. - For people who read the book, what do you hope is the message
  99. that's delivered to them? - We end with this message, and I think it is really the key, key
  100. thing, I believe, which is ultimately data and analytics, they attract a lot of attention. They are sexy, shiny objects,
  101. and they are, you know, interesting problems. They can also be scary and complicated, and all of that. So it's not
  102. surprising that so much attention is dedicated to them. But we never need -- we should never forget that data and
  103. algorithms are a means to an end. What matters in the end is the decisions that we make.
  104. - This is the book, <i>Decision- Driven Analytics. </i>Where can people pick it up right now?
  105. - On Amazon or any other platform where you buy your books, or at the Penn store.
  106. - Stefano, great to talk to you. Thanks very much for your time. Stefano Puntoni from here at the Wharton School. And again,
  107. the book, <i>Decision-Driven Analytics.</i> - Thank you for listening to the Ripple Effect. We hope you found this episode
  108. informative and engaging. Don't forget to subscribe and leave us a review so that we can continue to bring you the best insight
  109. from the Wharton School.

Brief Summary

Stefano Puntoni discusses decision-driven analytics and the importance of human judgment in data-driven decision making.

Key points

  • Decision-Driven Analytics. Stefano Puntoni discusses his book on leveraging human intelligence for better decision making with data.

Related episodes