Decision-Driven Analytics in the Era of AI
Ask about Knowledge at Wharton
Episode Description
EPISODE OVERVIEW Rather than mining data for insights, companies need to think more strategically about the decisions they need to make, and use data to help them get there. Wharton’s Stefano Puntoni says that’s the focus of his new book, “Decision-driven Analytics.”
PODCAST OVERVIEW Every day, business scholars answer pressing questions in their research - but what do their insights mean for you? In this podcast, Wharton faculty dive into what inspired their studies and how their findings resonate with the world today. Learn how research insights translate into knowledge you can use, with host Dan Loney.
Learn more at http://whr.tn/rippleeffect.
#analytics #AI #decisionmaking #leadership ----- The Wharton School of the University of Pennsylvania is committed to sharing its intellectual capital through Knowledge at Wharton, the school’s online business analysis journal.
Launched in 1999, Knowledge at Wharton offers free access to:
- Articles, podcasts, and videos highlighting Wharton faculty research and analysis of current business trends - Interviews with book authors from Wharton School Press - In-depth series of curated content like Wharton Executive Education’s Nano Tools for Leaders - A searchable database of more than 10,000 articles covering all aspects of business - A weekly newsletter that delivers Knowledge at Wharton insights directly to your inbox
Visit the Knowledge at Wharton homepage: https://whr.tn/3qUpSBE Subscribe to the Knowledge at Wharton YouTube channel: https://whr.tn/3DEAgAU
Read the full transcriptHide the full transcript
- Stefano Puntoni: But in many situations, we do have lots and lots of data. The problem is sometimes those data are not the data you
- need, or maybe those data are not being thought of the right way in terms of supporting the decisions that are important to make.
- Dan Loney: But I guess there is an importance that we need to kind of reinstall, in
- many cases, on the human component of this entire process. - Yeah, the human judgment is crucial. So actually, what I
- argue always is that as computers and algorithms become smarter and smarter, and the data becomes better and better, we
- should think harder, not less. And so in a way, the key message of the book almost is to say -- Dan Loney: And welcome to
- a special edition of Ripple Effect: Meet the Authors. I'm your host, Dan Loney. In each episode this month, the podcast
- will feature Wharton faculty authors in lively, fast moving conversations about their latest books and research. We're going
- to be covering a diverse range of topics, bringing you the latest insights and knowledge that you can apply to your life
- and to work. And hello, and welcome to the Ripple Effect: Meet the Author series. I'm your host the Dan Loney. Today we're
- talking with Stefano Puntoni about his book, <i>Decision-Driven</i> <i>Analytics</i>. Stefano's book is about leveraging human
- intelligence to unlock the power of data. And the book offers a new approach about making good decisions with data. Stefano,
- great to see you again. Thanks very much for your time today. And I guess let's start out with just explaining how you view, or
- what your definition of decision- driven analytics is. - Thanks, Dan, for having me. And I'm excited to be here and tell you
- a little bit about our new book. And the book is motivated by the problems that we see in many companies where analytics are
- complex. Companies have invested heavily. We have lots of data. And yet companies sometimes seem to struggle to extract value
- from that data. And what we argue in the book, basically, is that the gold standard that many companies have set themselves on,
- which is data-driven decision making, may to some extent, actually get the point wrong, meaning perhaps we argue
- it shouldn't be the decision making that is data driven. Instead, we argue it should be the data analytics that is
- decision driven, meaning rather than focusing on the data, and then trying to figure out how do we extract value to improve
- our decision making, it might be much better, in fact in many situations, to do the opposite. And say, let's start from the
- decisions that we need to make and figure out what data we need to make those decisions.
- - What kind of potential impact then have we maybe you've been looking at because -- that maybe the process hasn't
- been exactly the way that it should be and we're maybe not extracting the value that we really should? - The
- idea of data-driven decision making is not -- nobody argues that using data to make decisions is a bad idea. We need data to make
- good decisions. What we argue in the book is that the emphasis is wrong. And that, you know, the complexity and investments
- required to get the data systems in place, and all that work that has to be done, complex, technical, have attracted a lot
- of attention. And at some point, people end up in a situation where looking at data and trying to find a purpose for it, rather
- than looking at the questions that they need to answer and find data for that purpose.
- - Are there common mistakes that end up popping up as you've kind of investigated this by not going more of a data-driven
- perspective? - Yes, so the mistakes that we see companies do are basically of a variety of types. But the two that are very common are that
- companies sometimes end up answering the wrong questions, because they haven't connected the analytics to the decisions
- that they need to make very well. And because of that, they explore stuff that is actually not the stuff they should be
- exploring. And the second is that by focusing so much on the data, you almost end up putting this data on a pedestal and
- glorifying them to the extent where you might actually become uncritical of them, and not understanding what are the
- pitfalls that you might run into if you make decisions based on this data. And so the basic issue is actually that of a
- disconnect between decision making and data analytics, where there is this large gap between the people, the
- leaders who make the decisions, and the systems that are meant to support them. - I guess it's important to ask these questions right now,
- because it feels like we have more data than ever. And in many cases, I would assume the decision makers are probably
- inundated with this data, and maybe don't know how to parse through it and make the right call.
- - Yeah, it's like a strange irony in that for a long time companies were complaining they don't have data to make decisions. Now
- they're still complaining about data, but now they complain, oftentimes, you know, they have too much data, meaning that
- there's so many things that one could look at and it's a bit -- it's easy to get lost. Of course, we still have many
- situations where we don't have good data. And companies still are struggling to figure out ways in which they can achieve,
- you know, kind of evidence-based decision making in those situations. And I think we need to keep looking for great data
- there. But in many situations, we do have lots and lots of data. The problem is that sometimes those data are not the
- data you need, or maybe those data are not being thought of the right way in terms of supporting the decisions that
- are important to make. - But I guess there is an importance that we need to kind of
- reinstall, in many cases, on the human component of this entire process. - Yeah, the human judgment is crucial. So actually, what I
- argue always is that as computers and algorithms become smarter and smarter, and the data becomes better and better,
- we should think harder, not less. And so in a way, the key message of the book almost is to say that the secret to making
- good decisions with data is that before you even start looking at the data, you need to do a lot of thinking. So it takes a lot
- of thinking without data to make good decisions with data. - So we're now in a time where artificial intelligence is
- playing a bigger and bigger role in a lot of things that we do. How potentially does AI kind of impact the decision process and
- either make it better or worse, depending on all of this data that we have now in the mix? - Yeah,
- AI is the biggest thing happening today. And I'm very excited about all the work that the Wharton School is doing in
- the area of AI. In fact, our Dean, Erika James, just yesterday announced a major new initiative called the Wharton Initiative for
- AI and Analytics. And we're basically really pushing hard on what we know and what we can do to support business decision
- making. But AI here, as I think both, you know, a risk and an enormous upside potential, in that the risk is as we use more
- and more complex algorithms and technology, that gap that I mentioned earlier between decision making and the analyst
- is only risking to grow even larger, because now basically the decision makers have even a looser grasp of what these
- techniques can do and what they are about. And the people who are technical become so technical, they now lack, you
- know, a link to the business and maybe domain expertise that can help them be good partners for the leaders who are making
- decisions. So that's the risk part. But the upside potential is enormous. I think we are going to benefit in a million
- different ways from AI to improve our decision making, by automating decisions in a much smarter way, by providing tools
- that can help support human expert's decisions, and making sure that the scarce expertise of our human professionals is used
- for the cases where that expertise can really move the needle, and leave the rest to AI. - And
- the goal is still the same from the company's perspective. They're looking for the best outcome they can, you know,
- create, but you're going about it in a much more advanced way with all of these different components kind of in the mix
- now. - Yeah, for sure. AI is not going to tell you what you want, and what you should want. AI is going to just help you get
- there. So we still need the leadership, we still need human expertise and creativity, imagination to think about what
- the future might look like. - Does that then kind of take us into the discussion a little bit about
- what AI is going to mean for companies moving forward? Obviously, there's a lot of discussion about AI replacing
- humans. But it seems like more and more, a lot of people are coming around to the fact that AI will be complementary to
- humans. - It will be both them. But I think that a lot of the conversations around AI have this tone of human replacement,
- human or AI. Can we develop AI systems that emulate human capabilities? And the assumption of doing that, essentially, is
- to say, well, once we have the AI system that can do what the human does, maybe we don't need a human anymore. And I argue
- that business schools can play an important role to complement that perspective with a different one, which is what
- kinds of AI systems do we need to complement and augment human experience and human expertise? So instead of thinking about
- human or AI, can we think about human and AI? For example, we just started a course here. I'm teaching a course at Wharton
- called "AI In Our Lives." And the whole point is exactly to do that and think about, what can AI do, and how do we benefit from
- that? And then what is it that humans do incredibly well, and how do we design an AI system to support that?
- - I would imagine that when you look at the component of the decision process that will go on, you're talking about
- things that can impact top to bottom, up and down the corporate ladder in terms of all kinds of different decisions that may
- come into play. - Yeah, of course. In different functions, at different levels in the organization. And, you know, one point that we make in
- the book is that every decision making -- maker needs to consider what decisions are mine to make, and not worry about those are
- not yours to make. And of course, you can lobby, you can try to influence and bring, you know, issues to the table for
- those who make those decisions. But you should primarily focus on the decision you need to make and then find out how technology
- and data can help you making those decisions. - One of the other areas you talk about in the book are the
- decisions that end up having an impact either in the area of costs or the area of benefits. And I guess there's a dynamic of
- how that decision process will end up impacting the thought of the investment that a company may make, but obviously, the
- longer term benefit along the way as well. - Right, and that stems from the vision of the leadership, of
- course, what it is that we're trying to pursue. I think AI is one of those technologies, and analytics more broadly, that
- enables companies to think in different ways about the benefit that it can reap. Some of it might be efficiency. So it could be
- mostly a matter of making things smoother, better, reducing risks, and reducing costs, and managing things that way. But there is
- also a different way of thinking of it, and say how do we make things better and more effective? And perhaps not just
- say, how do we do what we do now better, but to think bigger and think about what is it that we are not currently doing that we
- could be doing. And that I think is the real potential of of data and AI. - For people who read the book, what do you hope is the message
- that's delivered to them? - We end with this message, and I think it is really the key, key
- thing, I believe, which is ultimately data and analytics, they attract a lot of attention. They are sexy, shiny objects,
- and they are, you know, interesting problems. They can also be scary and complicated, and all of that. So it's not
- surprising that so much attention is dedicated to them. But we never need -- we should never forget that data and
- algorithms are a means to an end. What matters in the end is the decisions that we make.
- - This is the book, <i>Decision- Driven Analytics. </i>Where can people pick it up right now?
- - On Amazon or any other platform where you buy your books, or at the Penn store.
- - Stefano, great to talk to you. Thanks very much for your time. Stefano Puntoni from here at the Wharton School. And again,
- the book, <i>Decision-Driven Analytics.</i> - Thank you for listening to the Ripple Effect. We hope you found this episode
- informative and engaging. Don't forget to subscribe and leave us a review so that we can continue to bring you the best insight
- from the Wharton School.
Brief Summary
Stefano Puntoni discusses decision-driven analytics and the importance of human judgment in data-driven decision making.
Key points
- Decision-Driven Analytics. Stefano Puntoni discusses his book on leveraging human intelligence for better decision making with data.





