Baseball, Bias and Decision-Making
Ask about Knowledge at Wharton
Episode Description
Wharton's Etan Green finds that umpires adjust their calls based on what information they think they know when a play is in motion. More: http://knlg.net/2ekcW3z π Management π·οΈ Research
Read the full transcriptHide the full transcript
- today we're speaking with Wharton professor 8 on green about his research on expert decision-making and
- specifically umpire calls in baseball so it sound happy with us thanks for joining us yeah my pleasure so can you
- give us an overview of your research yeah so generally what I'm interested in is decision-making by experts expertise
- particularly in realms for which there are predictions available from machines and machine based models algorithms or
- in the case of umpires in baseball data from stereoscopic cameras behind home plate of every major league ballpark
- that we use to benchmark the calls that umpires make and so this is a great setting for studying decision-making by
- experts because we have experts who are supposed to abide by a very specific decision rule so the pitcher throws a
- pitch if the pitch is in this imaginary box the official strike zone defined by the width of home plate on the floor and
- the batter stance then the umpires supposed to call a strike otherwise he's supposed to call a ball and so what we
- do is we use these data from the stereoscopic cameras that take a sequence of images of every pitch from
- its release from the pitchers hand until it crosses the region above home plate to basically observe to what extent the
- umpire abides by this decision rule to make his calls based solely on the location of the pitch and so I think the
- most interesting thing that comes out of the data is basically this deviation from that benchmark and very systematic
- way and so there's something in baseball called the count the count is keeps track of the sequence of pitches between
- a pitcher and a batter over the course of an at-bat if the count reaches for balls that's good for the batter he
- walks if it reaches three strikes that's good for the pitch or the batter strikes
- out and so what you see is that instead of the umpire just using the location of
- the pitch to make as calls pitches at the same location are sometimes called balls or sometimes called strikes
- depending on the count and in particular the strike zone expands dramatically when the count favor is the batter and
- so when account favors the batter the umpire responds by favoring the pitcher and vice versa when account favors the
- pitcher the Empire responds by favoring the batter and it's particularly extreme
- so basically you can think about a pitch that crosses say the top boundary of the
- official strike zone so this pitch and what I'll call baseline count the count at the beginning of the advance euro
- strikes this an umpire calls a strike fifty percent of the time it calls a ball fifty
- percent of the time you can think of as being a different between a ball and a strike but when the counts say has three
- balls and 0 strikes when it's strongly favored is the batter well then this pitch is almost always called a strike
- and the reverse is true in the opposite countless your balls and two strikes the
- same pitch at the same location is almost always called a ball so so why does this happen so they're potentially
- a number of stories that I can explain this result let me tell you about a particularly interesting and
- counterintuitive one and the argument here is that what the pitcher is do or what the umpire is doing is he's trading
- off accuracy for bias or rather he's trading off bias for accuracy he's being purposefully biased consciously or
- unconsciously so he's varying the strike zone that he enforces with the count he's not making his decisions based
- solely on the location of the pitch but the argument is this actually helps them
- make more accurate calls and why is this the case well imagine yourself as an umpire you're squatted behind the
- catcher you're looking out over his head towards the pitcher the pitcher winds up
- he throws a 90 plus mile an hour pitch it's there in an instant it has some lateral movements and vertical movement
- you have to decide whether this pitch is inside or outside some imaginary box it's an incredibly difficult problem and
- if you relied only on your observation of the location of the pitch you'd probably make mistakes on a regular
- basis frequently when the pitch is closed it'd be hard to say whether it was just inside the strike center just
- outside the strike zone but fortunately for you you have other information at your disposal you have expectations that
- you've built up over many years of being a professional umpire expectations about
- where the pitcher is going to throw in a certain count and whether the batter is
- going to swing and so for instance you might reasonably expect that when the count has three balls and 0 strikes that
- is when favor is the batter that the pitcher is going to try to throw a strike and so if the pitch is close and
- you're unsure whether it was just inside the strike zone or just outside the strike zone you may err on the side of
- calling a strike the pitch that you expect now think about what happens in an 02 count so in this count you expect
- that the batter is going to swing it anything close because if he doesn't he runs the chance
- of striking out whereas he can prolong liat bad if he fails the pitching off for instance and so imagine you see a
- pitch that appears close to you but the batter chooses not to swing how can you rationalize that decision well you can
- rationalize it by saying that he observes something that you didn't that his vantage point was such that he
- believed the pitch to be a ball and so you might err on the side of calling a ball and so this Bayesian updating this
- basically rational way of processing other information that you have creates this trade-off between bias and accuracy
- it helps the umpires become more accurate at the cost of having them systematically change the strike zone
- that they enforce with this variable the count that has nothing to do with their
- directive so what would you say a business practitioner should take away from your research yeah so I think what
- umpires are doing is they're statistically discriminating so they have a directive to make their calls
- based solely on the location of the pitch but that's very difficult to do it's very hard to observe the exact
- location every time and so what they do instead is they say well this other informations other information is
- correlated with the location in the pitch it could help me on average make more accurate calls and so as I said
- before they basically trade-off bias for accuracy it's a statistical discrimination at least opportunities
- for statistical discrimination are just they're everywhere and they're everywhere in the workplace in
- particularly in you know the hiring process so for instance you know when we hire we have a benchmark that sounds
- very similar to the umpires directive we want to hire the best person person is going to do the best of the job there's
- going to be the best fit but it's hard in the interview process looking at a CV or even interview i'm a person often to
- decide who is the best or how good is this person how good is this person going to be in the job and so we may
- rely on other factors factors that are either implicitly or explicitly banned that we shouldn't be using perhaps but
- factors that we believe perhaps rightly as in the case of the umpires or even erroneously to give us information about
- this person's fit and so if we're right we're going to get a little more accuracy but it's going to come look at
- the cost of bias it's going to come at the cost of systematic being able to systematically
- predict who we hire based on factors that have nothing to do at least directly with the dimension that we're
- trying to hire along so what are you going to look at next going to stay stay in baseball or look elsewhere for
- research yeah so I mean it's a baseball is an opportunity to use machine based models these cameras to say how good of
- a job umpires are doing but I think there are a lot of interesting cases in which the decisions that individuals
- make that experts make can be informed by algorithms by machine based predictions and so one of the things
- that I'm interested in particular now is making predictions about the election so
- it's particularly timely I think a lot of us are interested in the probability that Hillary Clinton is going to wait on
- the probability that Donald Trump will be our next president and so one place you may go to get information about this
- you may go to 538 nate silver's website and one thing that nate silver is doing this election season that he hasn't done
- in previous election seasons is he's providing multiple models so in the past he told you the probability that Hillary
- Clinton would win is seventy-seven percent now he's telling you if you believe this model it's seventy two
- percent if you believe this model it's eighty-four percent and sometimes there's really quite a deviation between
- these two models well what are these two models well basically they're making different assumptions about the world
- and your decision as to which model you listen to is really a decision about what what you believe the data
- generating process to be what do you believe the world to look like and in particular there's one model that says
- we should only listen to the pulse we should only listen to what people are saying right now and there's another
- model that says actually there are lots of predictors economic indicators for instance like that historically have
- been very predictive of election outcomes and so we should listen to those as well as your decision about
- which model to listen to her how to balance these two pieces of information basically comes down to your belief
- about whether this election season is totally different from the past in which case you should only listen to the polls
- or if you believe that this is just another draw and some stable distribution that is similar to
- everything else that's come before and so generally what I'm interested in is how can we frame questions what types
- of information can give people to make them think that this moment the present is just like the past and the past is a
- good predictor of the present and what types of information how can we frame questions to get people to think
- actually know the process is not stationary at all this moment is unique in time great that's fascinating thanks
- very much for joining us a time yeah my pleasure thank you you
Brief Summary
Wharton professor discusses umpire decision-making biases in baseball and their implications for accuracy and hiring practices.
Key points
- The Impact of the Count. How the count influences umpire decisions, affecting the strike zone.
- Decision-Making in Baseball. Exploring how umpires make calls based on pitch location and game context.
- Predicting Elections with Models. Using machine-based models to forecast election outcomes and their implications.
Episode highlights
- The Impact of the CountHow the count influences umpire decisions, affecting the strike zone.βThe count dramatically expands the strike zone.β1:50Oct 13, 2016
- Decision-Making in BaseballExploring how umpires make calls based on pitch location and game context.βUmpires trade off accuracy for bias.β2:57Oct 13, 2016
- Predicting Elections with ModelsUsing machine-based models to forecast election outcomes and their implications.βThis moment is unique in time.β9:16Oct 13, 2016
Tension
30/ 100Low tension





