Untangling Skill and Luck in Business
Ask about Knowledge at Wharton
Episode Description
How do we know which of our successes and failures can be attributed to either skill or luck? That is the question that investment strategist Michael J. Mauboussin explores in his book The Success Equation: Untangling Skill and Luck in Business, Sports, and Investing. Wharton management professor Adam M. Grant recently sat down with Mauboussin to talk about the paradox of skill, the conditions for luck and how to mitigate against overconfidence. 📂 Finance & Accounting
Read the full transcriptHide the full transcript
- [Music] [Music] Michael we're delighted to have you here today to talk about your book the success
- equation totally fascinating welcome thanks Adam great to be here I I would love to hear you talk a little bit about
- this paradox of scale that you've discovered sort of getting us to rethink the relationship between luck and skill
- yeah when we first tell you what the paradox of skill to find it specifically and it basically says in activities
- where there a skill and luck it defines outcomes as skill improves luck becomes more important to determining outcomes
- that means more skill means more luck which seems very paradoxical I she's not my idea I learned about it from Stephen
- Jay Gould very eminent biologist at Harvard and he talked about in the context of Ted Williams the last player
- to hit over 400 major league baseball what she did in 1941 and Gould was sort of wondering like why is no one being
- able to achieve over 400 since that time and he looked at things like maybe because the guys play at night or they
- travel too much really none of those things checked out and they said maybe maybe Williams just this amazing player
- you know sort of immortal among mortals and he said you know but if you look at every other sport for example things
- measured against the clock there has been absolute performance everywhere you look so that doesn't seem to be the case
- and then he sort of thought about it more careful and you realize the actual result is because everyone's gotten
- better and as a result the standard deviation of skill has actually narrowed right so if you think about batting
- average for your season your player it's some some level of skill plus some level
- lock gives you your outcome what's happened generally is the standard deviation of skill has gone down why
- because you're recruiting players from the world now versus just parts of United States your your training better
- your coaching better all those kinds of things so it turns out just to be statistical for a second the standard
- deviation of batting average in 1941 was about 0.32 they say notes point zero three two pardon me
- and now it's 0.28 so saying this differently Ted Williams was a four standard deviation event in 1941 if you
- were to be a four standard deviation event in 2011 now you'd hit 380 which is still awesome right but it below 400 so
- the point is this paradox of skill we've seen the differential skill narrowing we
- see really all over the place we see it in the world of invest we see in the world of business so I think it is very
- interesting as skill improves especially in competitive markets luck becomes more
- important determining outcomes it's incredibly interesting and much the opposite of what most of us want to
- believe so what do you do about this if you're taking this knowledge as a business professional or a leader well
- the couple things are possible one is to think about finding fields where there is differential skill right so if you if
- you see something that's very highly competitive you really have to have something completely different to get
- you on the right side of the tail just the tail of the skill distribution so that's probably the easiest things to
- think about things where there is differential skill or try to attack a more skillful player using an unusual
- tactic for example mm-hmm that makes a lot of sense and how do you explain obviously there's some outliers that
- sort of don't fit this picture I think of Miguel Cabrera winning the Triple Crown of course this past year is that
- luck or is there a way still to cultivate scale even though you're dependent on luck more than yeah and
- athletics is a great example so one of the points I would make which i think is a pretty common sense once I say it is
- that whenever you see an outlier in sports it's almost always where it is always a combination of really good
- skill and really good luck and and one of the best ways we can measure that for example is through streaks so for
- example Joe DiMaggio had this 56-game hitting streak but if you look at all the players in Major League Baseball
- history who have had 30 or more hitting streak hitting streaks their career batting average is over 300 so they're
- about one and a half or two standard deviations away from the average so saying it differently not all skillful
- player have skillful players have streaks but all streaks are held by skillful players so so I think you can
- almost be assured that whenever you see really really good results it's skill and luck combined by the way you almost
- never see it on the other side right which is like really bad luck in really bad skill because those people either
- metaphorically or literally kind of died off right in a population so so we mostly see the outliers on the on the
- positive side versus the negative side we don't see the failures so much mm-hmm and so I guess that raises the question
- for me are there ways that you can improve your luck yeah well maybe I should step back and define lot because
- I think that it's actually a fascinating topic and when you think about luck or read about it it really spills into
- philosophy like a philosophy very rapidly so and by weather as you know there are tons of aphorisms about lock
- right you know luck is where success meets preparation and you make your own luck but the way I'm going to define it
- actually those aphorisms while they have an important sentiment aren't actually not accurate so I'm going to define luck
- I'll say luck exists when three conditions are in place number one is it happens to an individual or organization
- so it could be you or your team or your company second is it can be good or bad and I don't mean to say that it's
- symmetrical so it could be you know they could be asymmetrical but but there's a
- positive sign and a negative sign and the third and i think a really essential one is it's reasonable to expect a
- different outcome could have occurred it's reasonable to expect a different outcome could occur so when those three
- things are in place I think there is luck now by my definition another simpler way to think about it is kind of
- what's in your control versus what's out of your control and luck would be sort of what's out of your control so when
- you hear the people say like well you know you make your own luck what they're encouraging to do is work harder or be
- persistent or be gritty and those are all really important things but if that's within your control in a sense I
- put that into the skill bucket so how do you how do you manage luck right a couple ideas i'll share one is there's a
- really simple heuristic that when you are the favorite the stronger player you have positive asymmetric resources you
- want to simplify the game when you're the underdog you want to complicate the game so that would be one example and of
- course the canonical example does David versus Goliath and by the way it's a which is a really a wonderful story if
- you read the whole story but interesting sort of David comes up and he's delivering stuff to his brothers and he
- sort of like there's this ruckus going on like oh what's going on this guy Goliath he's a 65 dude you know 130
- pounds of armor sort of threatening everybody and so david says yeah I can take this guy on and originally they put
- him in armor he's going to go in and go toe-to-toe with Goliath he's his little skinny shepherd boy and David gets us
- quickly like this ain't going to work so so he immediately takes off all the armor of course his famous slingshot and
- takes five stones from the creek and then he goes out and uses his own technique so in business that would be
- for example disruptive innovation so rather than going straight at the leader you kind of come out with a flank
- strategy in warfare would be gorilla stir oh jeez versus again toe-to-toe in in football it might be trick plays
- versus you know running straight down the middle and trying to do so so that would be one way for example that would
- be a classic way to and you say it's common sense when you say it but it's remarkable in business and spores and
- even in military how underutilized that strategy is yeah I think that makes a lot of sense and it raises sort of
- another interesting question which is you're familiar with the really robust evidence for over confidence that you
- know if you take any sort of standard study David Donny's colleagues I think I've done some of the most interesting
- ones people assume about ninety percent of any people you would ask would assume
- they're above average on any given a track you know intelligence scale etc and so you know what you're saying
- basically requires people to assess whether they're a favorite or an underdog we know people are biased
- toward thinking that they're favourites so how do you temper that level of overconfidence to make good judgments
- about how to change the rules of a game yeah I mean that's a really interesting one I mean part of this is I want to
- frame once I like on this is going back to sort of the I think the Danny Kahneman Kahneman really Tversky idea of
- inside versus outside view right so you're very familiar with this but you know the outside views well the inside
- view says when we're trying to solve a problem or tackle something the typical way that we do it and this is where I
- overconfidence plays into this is we we kind of you know gather lots of information about the situation we
- combine it with our own poets and then we project into the future right so sort of almost idea Socratic might be strong
- but it's sort of your own point of view the outside view by contrast is I'm look
- at that problem as an instance of a larger reference class so i'm going to ask what happened when other people were
- in this situation before and i think that's one of the ways to sort of temper temper that overconfidence to say rather
- than looking at this sort of my own unique situation where i think i'm above average i'm going to look at what's
- happened to everybody else has tried this before now i actually ambivalent about this argument on one level right
- because if you're an entrepreneur like we want entrepreneurs but we know that a high percentage of them are going to
- fail right but we know that some small percent are going to succeed and create enormous amount of value for you know
- for society and so forth so so you want the our chores to get out of bed in the morning go like I'm going to go take the
- mountain right but if you step back and said no statistically right that's probably not a great so so I'm a little
- bit about the arm but that would be one of the ways I think you try to temper that the other thing I mentioned quickly
- on this is I think there's a really interesting literature this you know it's called under sampling failure right
- which is people a company or our team will pursue particular strategy and they'll succeed wildly another team or
- company will pursue a very similar strategy and fail but of course the failures go away and so what happens is
- you walk along go okay what strategy works and you see that strategy and you see success and so you say that's got to
- be great you understand both a yer so that's another way to sort of temper some of the thinking is to say I won't
- understand really the entirety what's happened with this strategy for example so that might be some ideas about how to
- how to mitigate the overconfidence yeah I think that's very helpful and it actually connects to one of your other
- really interesting points in the book which is about using better statistics can you talk to us a little bit about
- about how you would do that as a business leader yeah so you know we're awash in statistics right you watch a
- ball game or you read the business page of a newspaper or what have you and we know that they're not all created
- equally right so what makes for a useful statistic and what I basically argue for
- why you're uh she gets us from the sabermetrics guys that sports statistics guys is you really want two things one
- is you want persistence and the second is you want predictive value so persistent simply means that the actual
- statistic is correlated from one period to the next so for instance if I know your batting average for 2012 it would
- correlate highly with your batting average in 2013 or how well would correlate would be a measure of
- persistence the second thing is predictive value so you want that statistic to actually correlate highly
- with the objective you're trying to achieve so for example in baseball on offense you're trying to generate runs
- so the question is how well does batting average correlate with run production let me tie this back to Moneyball right
- I mean this is there are a lot of different themes in Moneyball but one of them was a simple one which is on base
- percentage is a better measure of performance than batting average and what they found was on base percentage
- has a higher correlation from one season to the next which means it's more indicative of skill than batting average
- does so it's going to pass the persistence test and then secondly on-base percentage actually call is
- higher with run production then does batting average so that's going to say that is a superior
- statistic because it's more persistent and it's more predictive and I should I should have backed up said hi
- persistence is almost always indicative of high skill low persistence typically lots of luck so let's take sort of maybe
- an exception to that rule which is when you think about the interdependence of different players on a baseball team or
- for example in a company to you could assume that you know given on-base percentage is attributable to scale but
- then you end up batting right after another highly talented batter and that's going to increase in general your
- on-base percentage right now so how do you decouple sort of the individual scale from the context in which you find
- yourselves super difficult right super difficult so part of what I when I did the work on on-base percentage i
- actually did I step to try to sidestep the problem you just articulated I did it on a team level versus an individual
- level I think that of course they're going to roll up on some level but but you're right and so it's it's I think
- it's a major step in the right direction but in some ways it can be a fairly blunt instrument so I think they're
- really careful statistical people try to understand exactly if you're batting in
- a different order what have you what impact will that have and try to measure that out and try to extract that effect
- but this also leads to another port that's more more broad which is for example to take sports which is very
- simple you know tennis is one on one and we have a large sample if we play a five-set match there's a large sample
- size right so we pretty much know by the end of ten of match tennis match who which of us has been more skillful but
- as you said like you get into a football game or football you're you know a football for us at world right soccer
- there are a lot of players a lot of interaction and identifying those effects of individuals is a vastly more
- challenging task now again doesn't mean you shouldn't try or try to gain some insight into doing that but you're right
- that the degree of difficulty goes up as you add complexity and of course corporations same thing there's a lot of
- moving parts very difficult often to say this that or the other cause one thing or another so you mentioned Danny
- condiments work earlier and he's added another really interesting variable to the equation which is are you working in
- an environment that's stable and predictable or much more turbulent and he's made the point that you can rely on
- your scale and your expertise in your intuition much more in a predictable environment but most of us don't have
- the luxury anymore of working in these very predictable and fire it's so how do you think about navigating a more
- uncertain world yeah this is such a fascinating topic I wrote a chapter about this in my prior book and I call
- it the expert squeeze and I basically said the main way to think about expertise is to think about precisely
- that continuum you just laid out so what's interesting in some fields there things are the environment stable I like
- to often say it's stable and lynna linear so cause and effect are very clear and those realms you can train
- your system 10 Danny call so you can train your sort of subconscious to be really good the challenge is
- increasingly especially in a business setting is that computers are taking on those tasks professional tasks and can
- do them very efficiently and cheaply so experts are good at those but increasingly there's an encroachment
- from technology that's and that's been a very that's a challenging situation the
- opposite extreme is you point out our environments that are unstable and nonlinear and there we know that experts
- are very poor predictors and there's really no way to train your system one your subconscious and so I always love
- to make this distinction especially I'm in the finance business the big deal between experience and expertise and
- people often think that experience and expertise sort of equal each other and that's true on the stable side of the
- continuum but when you're on the unstable nonlinear side of the continuum your experience really doesn't and the
- key to experience expertise part of me is having a predictive model that works and you don't really have a pretty good
- model that works so there we know that experts do very very poorly in their predictions and by the way you know this
- is early 2013 this is the time of year everybody's making predictions about what's going to happen and of course
- most people keep track of those things know that they're they're notoriously very poor what's interesting though is
- that we're seeing in some cases called the wisdom of crowds that collectives can be more effective than experts in
- making judgments in those kinds of areas under certain conditions so I call this
- the expert squeeze because experts are getting squeezed on this unstable nonlinear side by wisdom of crowds
- properly harnessed and they're getting squeezed on the other side by computers and technology and there's less space in
- the middle for the experts to to navigate than they used to have so I think this is this is a fundamental
- first question to ask is the problem i'm trying to think about where is it on that continuing from stable linear too
- unstable nonlinear and that really dictates a lot about how you should think about solving it and by what means
- and techniques as well mm-hmm so to build on that it seems like unlearning is a big part of the equation there
- there's some work that Nancy rothbard here in Wharton was involved in showing that people actually when they move from
- one company to another end up getting hurt by experience because they carry a lot of baggage with them about what
- worked in a particular context that's no longer relevant to their new context do
- any wisdom to share about how to unlearn some things now I don't but you know this is such a this is a I mean I big
- obviously there's a big theme in all social psychology right which is caught the context of where you are is
- incredibly important in shaping the decisions that you make so right you have certain experience your socialized
- within an organization at certain way and so those experiences and even imprinting is you know so that the son
- of first kinds of experiences you have kind of deeply carry you through your decision making for often the rest of
- your career so I think it's a really hard thing to unlearn but it's all it can be at the same time very useful just
- to be mindful that while we'd love to think of ourselves as rational and objective and fact-based in our own
- decisions is it that social context be it new or old organization or whatever is going around you is deeply
- influential on how you decide and that that inserts a lot of humility but maybe raises awareness to help people get more
- effective at making their decisions mm-hmm so you work in the world of finance how do you take all this
- knowledge and apply it to achieve success in your own job yeah so there are a number of different angles on that
- one is that I like to I call it macro where but macro agnostic which is to say spend as little time as possible
- predicting sort of big things in the world you have to be aware what's going on obviously and while those things may
- in fact have an impact on various scenarios that might happen for a company or an economy but try to be
- macro where macro agnostic now the second thing is just thinking about what statistics are useful for example to
- apply that template to thinking about money managers so for example hey who which money managers likely to succeed
- in the future and and we know that past results are typically in in effective way to anticipate future
- results but an isolation on process a manager's process might give us a better insight so there are statistical ways
- that we can start to take a glimpse get a glimpse at process I think they can be
- very helpful another thing I'll mention is you know you mentioned overconfidence
- before we talked about that that's that's also rife obviously the investment business and even as an
- analyst trying to anticipate a company's performance one of the classic ways that
- that shows up is people project ranges of outcomes for example sales growth rates or profit levels that are vastly
- too narrow in others there over call for their own ability to understand the future so just getting people to widen
- out those ranges to think more robustly about that can be very very helpful so there's almost no facet of Finance where
- these ideas don't touch and can't help very hard to do a day to day but awareness and then again tools and
- techniques to try to manage it to minimize the mistakes i think is a great value so you managed to do all of this
- and keep up to date on the latest evidence that might inform these practices how do you juggle these two
- things simultaneously a part of it I'm pretty bad at everything is yes sir so no I think a lot of is just a natural
- curiosity I'm also one of things has been very helpful for me is teaching as an adjunct so I'm not a real professor
- like you are but a heralded professor but but I'm being an adjunct for me has been very helpful and in part the way I
- think about it is to try to take the very best of what academics bring to the table and the very best of practitioner
- so so what academics do I think that's very helpful is tend to be rigorous to eat their method using the scientific
- method to understand and explore ideas but they're not always totally practical so I think what the practitioners bring
- to it is hey you know we have to make money and we have to have a practical angle on it so so taking the best of
- both of those worlds and trying to combine them i think is what's been for me the most satisfying aspect of this
- and again if there's something you can draw from the world of academia that can improve your performance in some way
- that's great and i'll say this that it's interesting i've been at columbia I'm about to start my 21st year teaching
- there and when I started there there was really no behavioral finance program in
- fact I often recommend the students take negotiation courses because that was the
- closest you got to sort of tapping into some of these ideas from what we now call behavioral finance that's obviously
- come a long way and I think these are extraordinarily useful ideas but shockingly there are whole generations
- including my own generation of people who never learn this in the classroom unless you go out on your own in fact
- and learn these things now and try to put them into your process you're sort of a blind spot in a lot of your
- decision-making so that that's also fascinating things a lot of people running corporations have never learned
- about these ideas and they have this blind spot and trying to try to fill that in a little bit i think it's been
- really really fun activity i think that's a wonderful call to action and Michael thank you for joining us today
- my pleasure thanks [Music] you
Brief Summary
Michael Mauboussin discusses skill, luck, and decision-making strategies in business from his book "The Success Equation."
Key points
- The Paradox of Skill. As skill improves in competitive markets, luck becomes more important in determining outcomes.
- Defining Luck. Luck exists when three conditions are met: it affects an individual, can be good or bad, and a different outcome was possible.
- The Expert Squeeze. Experts face challenges in unstable environments as technology and collective wisdom encroach on their expertise.
- The Importance of Context. Context shapes our decisions more than we realize, influencing our career paths.
- Unlearning Past Experiences. Unlearning ingrained experiences is tough but can lead to better decision-making.
- Behavioral Finance in Practice. Behavioral finance principles are crucial across all areas of finance.
Episode highlights
- The Paradox of SkillAs skill improves in competitive markets, luck becomes more important in determining outcomes.“More skill means more luck, which seems very paradoxical.”0:45Mar 6, 2013
- Defining LuckLuck exists when three conditions are met: it affects an individual, can be good or bad, and a different outcome was possible.“Luck exists when three conditions are in place.”4:58Mar 6, 2013
- The Expert SqueezeExperts face challenges in unstable environments as technology and collective wisdom encroach on their expertise.“Experts are getting squeezed on the unstable nonlinear side by wisdom of crowds.”15:30Mar 6, 2013
- The Importance of ContextContext shapes our decisions more than we realize, influencing our career paths.“The context of where you are is incredibly important.”16:31Mar 6, 2013
- Unlearning Past ExperiencesUnlearning ingrained experiences is tough but can lead to better decision-making.“It’s a really hard thing to unlearn, but it can be very useful.”16:50Mar 6, 2013
- Behavioral Finance in PracticeBehavioral finance principles are crucial across all areas of finance.“There’s almost no facet of finance where these ideas don’t touch.”18:51Mar 6, 2013
- Knowledge Gaps in CorporationsMany leaders lack awareness of behavioral finance, creating blind spots in decisions.“A lot of people running corporations have never learned about these ideas.”20:44Mar 6, 2013
Tension
45/ 100Some tension





