Untangling Skill and Luck in Business

Knowledge at Wharton

Ask about Knowledge at Wharton

Episode Description

How do we know which of our successes and failures can be attributed to either skill or luck? That is the question that investment strategist Michael J. Mauboussin explores in his book The Success Equation: Untangling Skill and Luck in Business, Sports, and Investing. Wharton management professor Adam M. Grant recently sat down with Mauboussin to talk about the paradox of skill, the conditions for luck and how to mitigate against overconfidence. 📂 Finance & Accounting

Read the full transcriptHide the full transcript
  1. [Music] [Music] Michael we're delighted to have you here today to talk about your book the success
  2. equation totally fascinating welcome thanks Adam great to be here I I would love to hear you talk a little bit about
  3. this paradox of scale that you've discovered sort of getting us to rethink the relationship between luck and skill
  4. yeah when we first tell you what the paradox of skill to find it specifically and it basically says in activities
  5. where there a skill and luck it defines outcomes as skill improves luck becomes more important to determining outcomes
  6. that means more skill means more luck which seems very paradoxical I she's not my idea I learned about it from Stephen
  7. Jay Gould very eminent biologist at Harvard and he talked about in the context of Ted Williams the last player
  8. to hit over 400 major league baseball what she did in 1941 and Gould was sort of wondering like why is no one being
  9. able to achieve over 400 since that time and he looked at things like maybe because the guys play at night or they
  10. travel too much really none of those things checked out and they said maybe maybe Williams just this amazing player
  11. you know sort of immortal among mortals and he said you know but if you look at every other sport for example things
  12. measured against the clock there has been absolute performance everywhere you look so that doesn't seem to be the case
  13. and then he sort of thought about it more careful and you realize the actual result is because everyone's gotten
  14. better and as a result the standard deviation of skill has actually narrowed right so if you think about batting
  15. average for your season your player it's some some level of skill plus some level
  16. lock gives you your outcome what's happened generally is the standard deviation of skill has gone down why
  17. because you're recruiting players from the world now versus just parts of United States your your training better
  18. your coaching better all those kinds of things so it turns out just to be statistical for a second the standard
  19. deviation of batting average in 1941 was about 0.32 they say notes point zero three two pardon me
  20. and now it's 0.28 so saying this differently Ted Williams was a four standard deviation event in 1941 if you
  21. were to be a four standard deviation event in 2011 now you'd hit 380 which is still awesome right but it below 400 so
  22. the point is this paradox of skill we've seen the differential skill narrowing we
  23. see really all over the place we see it in the world of invest we see in the world of business so I think it is very
  24. interesting as skill improves especially in competitive markets luck becomes more
  25. important determining outcomes it's incredibly interesting and much the opposite of what most of us want to
  26. believe so what do you do about this if you're taking this knowledge as a business professional or a leader well
  27. the couple things are possible one is to think about finding fields where there is differential skill right so if you if
  28. you see something that's very highly competitive you really have to have something completely different to get
  29. you on the right side of the tail just the tail of the skill distribution so that's probably the easiest things to
  30. think about things where there is differential skill or try to attack a more skillful player using an unusual
  31. tactic for example mm-hmm that makes a lot of sense and how do you explain obviously there's some outliers that
  32. sort of don't fit this picture I think of Miguel Cabrera winning the Triple Crown of course this past year is that
  33. luck or is there a way still to cultivate scale even though you're dependent on luck more than yeah and
  34. athletics is a great example so one of the points I would make which i think is a pretty common sense once I say it is
  35. that whenever you see an outlier in sports it's almost always where it is always a combination of really good
  36. skill and really good luck and and one of the best ways we can measure that for example is through streaks so for
  37. example Joe DiMaggio had this 56-game hitting streak but if you look at all the players in Major League Baseball
  38. history who have had 30 or more hitting streak hitting streaks their career batting average is over 300 so they're
  39. about one and a half or two standard deviations away from the average so saying it differently not all skillful
  40. player have skillful players have streaks but all streaks are held by skillful players so so I think you can
  41. almost be assured that whenever you see really really good results it's skill and luck combined by the way you almost
  42. never see it on the other side right which is like really bad luck in really bad skill because those people either
  43. metaphorically or literally kind of died off right in a population so so we mostly see the outliers on the on the
  44. positive side versus the negative side we don't see the failures so much mm-hmm and so I guess that raises the question
  45. for me are there ways that you can improve your luck yeah well maybe I should step back and define lot because
  46. I think that it's actually a fascinating topic and when you think about luck or read about it it really spills into
  47. philosophy like a philosophy very rapidly so and by weather as you know there are tons of aphorisms about lock
  48. right you know luck is where success meets preparation and you make your own luck but the way I'm going to define it
  49. actually those aphorisms while they have an important sentiment aren't actually not accurate so I'm going to define luck
  50. I'll say luck exists when three conditions are in place number one is it happens to an individual or organization
  51. so it could be you or your team or your company second is it can be good or bad and I don't mean to say that it's
  52. symmetrical so it could be you know they could be asymmetrical but but there's a
  53. positive sign and a negative sign and the third and i think a really essential one is it's reasonable to expect a
  54. different outcome could have occurred it's reasonable to expect a different outcome could occur so when those three
  55. things are in place I think there is luck now by my definition another simpler way to think about it is kind of
  56. what's in your control versus what's out of your control and luck would be sort of what's out of your control so when
  57. you hear the people say like well you know you make your own luck what they're encouraging to do is work harder or be
  58. persistent or be gritty and those are all really important things but if that's within your control in a sense I
  59. put that into the skill bucket so how do you how do you manage luck right a couple ideas i'll share one is there's a
  60. really simple heuristic that when you are the favorite the stronger player you have positive asymmetric resources you
  61. want to simplify the game when you're the underdog you want to complicate the game so that would be one example and of
  62. course the canonical example does David versus Goliath and by the way it's a which is a really a wonderful story if
  63. you read the whole story but interesting sort of David comes up and he's delivering stuff to his brothers and he
  64. sort of like there's this ruckus going on like oh what's going on this guy Goliath he's a 65 dude you know 130
  65. pounds of armor sort of threatening everybody and so david says yeah I can take this guy on and originally they put
  66. him in armor he's going to go in and go toe-to-toe with Goliath he's his little skinny shepherd boy and David gets us
  67. quickly like this ain't going to work so so he immediately takes off all the armor of course his famous slingshot and
  68. takes five stones from the creek and then he goes out and uses his own technique so in business that would be
  69. for example disruptive innovation so rather than going straight at the leader you kind of come out with a flank
  70. strategy in warfare would be gorilla stir oh jeez versus again toe-to-toe in in football it might be trick plays
  71. versus you know running straight down the middle and trying to do so so that would be one way for example that would
  72. be a classic way to and you say it's common sense when you say it but it's remarkable in business and spores and
  73. even in military how underutilized that strategy is yeah I think that makes a lot of sense and it raises sort of
  74. another interesting question which is you're familiar with the really robust evidence for over confidence that you
  75. know if you take any sort of standard study David Donny's colleagues I think I've done some of the most interesting
  76. ones people assume about ninety percent of any people you would ask would assume
  77. they're above average on any given a track you know intelligence scale etc and so you know what you're saying
  78. basically requires people to assess whether they're a favorite or an underdog we know people are biased
  79. toward thinking that they're favourites so how do you temper that level of overconfidence to make good judgments
  80. about how to change the rules of a game yeah I mean that's a really interesting one I mean part of this is I want to
  81. frame once I like on this is going back to sort of the I think the Danny Kahneman Kahneman really Tversky idea of
  82. inside versus outside view right so you're very familiar with this but you know the outside views well the inside
  83. view says when we're trying to solve a problem or tackle something the typical way that we do it and this is where I
  84. overconfidence plays into this is we we kind of you know gather lots of information about the situation we
  85. combine it with our own poets and then we project into the future right so sort of almost idea Socratic might be strong
  86. but it's sort of your own point of view the outside view by contrast is I'm look
  87. at that problem as an instance of a larger reference class so i'm going to ask what happened when other people were
  88. in this situation before and i think that's one of the ways to sort of temper temper that overconfidence to say rather
  89. than looking at this sort of my own unique situation where i think i'm above average i'm going to look at what's
  90. happened to everybody else has tried this before now i actually ambivalent about this argument on one level right
  91. because if you're an entrepreneur like we want entrepreneurs but we know that a high percentage of them are going to
  92. fail right but we know that some small percent are going to succeed and create enormous amount of value for you know
  93. for society and so forth so so you want the our chores to get out of bed in the morning go like I'm going to go take the
  94. mountain right but if you step back and said no statistically right that's probably not a great so so I'm a little
  95. bit about the arm but that would be one of the ways I think you try to temper that the other thing I mentioned quickly
  96. on this is I think there's a really interesting literature this you know it's called under sampling failure right
  97. which is people a company or our team will pursue particular strategy and they'll succeed wildly another team or
  98. company will pursue a very similar strategy and fail but of course the failures go away and so what happens is
  99. you walk along go okay what strategy works and you see that strategy and you see success and so you say that's got to
  100. be great you understand both a yer so that's another way to sort of temper some of the thinking is to say I won't
  101. understand really the entirety what's happened with this strategy for example so that might be some ideas about how to
  102. how to mitigate the overconfidence yeah I think that's very helpful and it actually connects to one of your other
  103. really interesting points in the book which is about using better statistics can you talk to us a little bit about
  104. about how you would do that as a business leader yeah so you know we're awash in statistics right you watch a
  105. ball game or you read the business page of a newspaper or what have you and we know that they're not all created
  106. equally right so what makes for a useful statistic and what I basically argue for
  107. why you're uh she gets us from the sabermetrics guys that sports statistics guys is you really want two things one
  108. is you want persistence and the second is you want predictive value so persistent simply means that the actual
  109. statistic is correlated from one period to the next so for instance if I know your batting average for 2012 it would
  110. correlate highly with your batting average in 2013 or how well would correlate would be a measure of
  111. persistence the second thing is predictive value so you want that statistic to actually correlate highly
  112. with the objective you're trying to achieve so for example in baseball on offense you're trying to generate runs
  113. so the question is how well does batting average correlate with run production let me tie this back to Moneyball right
  114. I mean this is there are a lot of different themes in Moneyball but one of them was a simple one which is on base
  115. percentage is a better measure of performance than batting average and what they found was on base percentage
  116. has a higher correlation from one season to the next which means it's more indicative of skill than batting average
  117. does so it's going to pass the persistence test and then secondly on-base percentage actually call is
  118. higher with run production then does batting average so that's going to say that is a superior
  119. statistic because it's more persistent and it's more predictive and I should I should have backed up said hi
  120. persistence is almost always indicative of high skill low persistence typically lots of luck so let's take sort of maybe
  121. an exception to that rule which is when you think about the interdependence of different players on a baseball team or
  122. for example in a company to you could assume that you know given on-base percentage is attributable to scale but
  123. then you end up batting right after another highly talented batter and that's going to increase in general your
  124. on-base percentage right now so how do you decouple sort of the individual scale from the context in which you find
  125. yourselves super difficult right super difficult so part of what I when I did the work on on-base percentage i
  126. actually did I step to try to sidestep the problem you just articulated I did it on a team level versus an individual
  127. level I think that of course they're going to roll up on some level but but you're right and so it's it's I think
  128. it's a major step in the right direction but in some ways it can be a fairly blunt instrument so I think they're
  129. really careful statistical people try to understand exactly if you're batting in
  130. a different order what have you what impact will that have and try to measure that out and try to extract that effect
  131. but this also leads to another port that's more more broad which is for example to take sports which is very
  132. simple you know tennis is one on one and we have a large sample if we play a five-set match there's a large sample
  133. size right so we pretty much know by the end of ten of match tennis match who which of us has been more skillful but
  134. as you said like you get into a football game or football you're you know a football for us at world right soccer
  135. there are a lot of players a lot of interaction and identifying those effects of individuals is a vastly more
  136. challenging task now again doesn't mean you shouldn't try or try to gain some insight into doing that but you're right
  137. that the degree of difficulty goes up as you add complexity and of course corporations same thing there's a lot of
  138. moving parts very difficult often to say this that or the other cause one thing or another so you mentioned Danny
  139. condiments work earlier and he's added another really interesting variable to the equation which is are you working in
  140. an environment that's stable and predictable or much more turbulent and he's made the point that you can rely on
  141. your scale and your expertise in your intuition much more in a predictable environment but most of us don't have
  142. the luxury anymore of working in these very predictable and fire it's so how do you think about navigating a more
  143. uncertain world yeah this is such a fascinating topic I wrote a chapter about this in my prior book and I call
  144. it the expert squeeze and I basically said the main way to think about expertise is to think about precisely
  145. that continuum you just laid out so what's interesting in some fields there things are the environment stable I like
  146. to often say it's stable and lynna linear so cause and effect are very clear and those realms you can train
  147. your system 10 Danny call so you can train your sort of subconscious to be really good the challenge is
  148. increasingly especially in a business setting is that computers are taking on those tasks professional tasks and can
  149. do them very efficiently and cheaply so experts are good at those but increasingly there's an encroachment
  150. from technology that's and that's been a very that's a challenging situation the
  151. opposite extreme is you point out our environments that are unstable and nonlinear and there we know that experts
  152. are very poor predictors and there's really no way to train your system one your subconscious and so I always love
  153. to make this distinction especially I'm in the finance business the big deal between experience and expertise and
  154. people often think that experience and expertise sort of equal each other and that's true on the stable side of the
  155. continuum but when you're on the unstable nonlinear side of the continuum your experience really doesn't and the
  156. key to experience expertise part of me is having a predictive model that works and you don't really have a pretty good
  157. model that works so there we know that experts do very very poorly in their predictions and by the way you know this
  158. is early 2013 this is the time of year everybody's making predictions about what's going to happen and of course
  159. most people keep track of those things know that they're they're notoriously very poor what's interesting though is
  160. that we're seeing in some cases called the wisdom of crowds that collectives can be more effective than experts in
  161. making judgments in those kinds of areas under certain conditions so I call this
  162. the expert squeeze because experts are getting squeezed on this unstable nonlinear side by wisdom of crowds
  163. properly harnessed and they're getting squeezed on the other side by computers and technology and there's less space in
  164. the middle for the experts to to navigate than they used to have so I think this is this is a fundamental
  165. first question to ask is the problem i'm trying to think about where is it on that continuing from stable linear too
  166. unstable nonlinear and that really dictates a lot about how you should think about solving it and by what means
  167. and techniques as well mm-hmm so to build on that it seems like unlearning is a big part of the equation there
  168. there's some work that Nancy rothbard here in Wharton was involved in showing that people actually when they move from
  169. one company to another end up getting hurt by experience because they carry a lot of baggage with them about what
  170. worked in a particular context that's no longer relevant to their new context do
  171. any wisdom to share about how to unlearn some things now I don't but you know this is such a this is a I mean I big
  172. obviously there's a big theme in all social psychology right which is caught the context of where you are is
  173. incredibly important in shaping the decisions that you make so right you have certain experience your socialized
  174. within an organization at certain way and so those experiences and even imprinting is you know so that the son
  175. of first kinds of experiences you have kind of deeply carry you through your decision making for often the rest of
  176. your career so I think it's a really hard thing to unlearn but it's all it can be at the same time very useful just
  177. to be mindful that while we'd love to think of ourselves as rational and objective and fact-based in our own
  178. decisions is it that social context be it new or old organization or whatever is going around you is deeply
  179. influential on how you decide and that that inserts a lot of humility but maybe raises awareness to help people get more
  180. effective at making their decisions mm-hmm so you work in the world of finance how do you take all this
  181. knowledge and apply it to achieve success in your own job yeah so there are a number of different angles on that
  182. one is that I like to I call it macro where but macro agnostic which is to say spend as little time as possible
  183. predicting sort of big things in the world you have to be aware what's going on obviously and while those things may
  184. in fact have an impact on various scenarios that might happen for a company or an economy but try to be
  185. macro where macro agnostic now the second thing is just thinking about what statistics are useful for example to
  186. apply that template to thinking about money managers so for example hey who which money managers likely to succeed
  187. in the future and and we know that past results are typically in in effective way to anticipate future
  188. results but an isolation on process a manager's process might give us a better insight so there are statistical ways
  189. that we can start to take a glimpse get a glimpse at process I think they can be
  190. very helpful another thing I'll mention is you know you mentioned overconfidence
  191. before we talked about that that's that's also rife obviously the investment business and even as an
  192. analyst trying to anticipate a company's performance one of the classic ways that
  193. that shows up is people project ranges of outcomes for example sales growth rates or profit levels that are vastly
  194. too narrow in others there over call for their own ability to understand the future so just getting people to widen
  195. out those ranges to think more robustly about that can be very very helpful so there's almost no facet of Finance where
  196. these ideas don't touch and can't help very hard to do a day to day but awareness and then again tools and
  197. techniques to try to manage it to minimize the mistakes i think is a great value so you managed to do all of this
  198. and keep up to date on the latest evidence that might inform these practices how do you juggle these two
  199. things simultaneously a part of it I'm pretty bad at everything is yes sir so no I think a lot of is just a natural
  200. curiosity I'm also one of things has been very helpful for me is teaching as an adjunct so I'm not a real professor
  201. like you are but a heralded professor but but I'm being an adjunct for me has been very helpful and in part the way I
  202. think about it is to try to take the very best of what academics bring to the table and the very best of practitioner
  203. so so what academics do I think that's very helpful is tend to be rigorous to eat their method using the scientific
  204. method to understand and explore ideas but they're not always totally practical so I think what the practitioners bring
  205. to it is hey you know we have to make money and we have to have a practical angle on it so so taking the best of
  206. both of those worlds and trying to combine them i think is what's been for me the most satisfying aspect of this
  207. and again if there's something you can draw from the world of academia that can improve your performance in some way
  208. that's great and i'll say this that it's interesting i've been at columbia I'm about to start my 21st year teaching
  209. there and when I started there there was really no behavioral finance program in
  210. fact I often recommend the students take negotiation courses because that was the
  211. closest you got to sort of tapping into some of these ideas from what we now call behavioral finance that's obviously
  212. come a long way and I think these are extraordinarily useful ideas but shockingly there are whole generations
  213. including my own generation of people who never learn this in the classroom unless you go out on your own in fact
  214. and learn these things now and try to put them into your process you're sort of a blind spot in a lot of your
  215. decision-making so that that's also fascinating things a lot of people running corporations have never learned
  216. about these ideas and they have this blind spot and trying to try to fill that in a little bit i think it's been
  217. really really fun activity i think that's a wonderful call to action and Michael thank you for joining us today
  218. my pleasure thanks [Music] you

Brief Summary

Michael Mauboussin discusses skill, luck, and decision-making strategies in business from his book "The Success Equation."

Key points

  • The Paradox of Skill. As skill improves in competitive markets, luck becomes more important in determining outcomes.
  • Defining Luck. Luck exists when three conditions are met: it affects an individual, can be good or bad, and a different outcome was possible.
  • The Expert Squeeze. Experts face challenges in unstable environments as technology and collective wisdom encroach on their expertise.
  • The Importance of Context. Context shapes our decisions more than we realize, influencing our career paths.
  • Unlearning Past Experiences. Unlearning ingrained experiences is tough but can lead to better decision-making.
  • Behavioral Finance in Practice. Behavioral finance principles are crucial across all areas of finance.

Tension

45/ 100Some tension

Related episodes