Chang Welton SF
Ask about Knowledge at Wharton
Read the full transcriptHide the full transcript
- I first got introduced to the forecast ra by a long time mine at Dartmouth been Valentino who is
- a political scientist and he alerted me to an opportunity to forecast with the good judgment project and this was right
- around the time when i was leaving baghdad iraq after my second tour there and i was looking for some way of doing
- forecasting because i've been something that I've been interested in for for a while and that's why been introduced me
- to this idea and you know I the timing worked out as well I was able to come back to the United States and that was
- right around the time the the first year of the tournament kicked off and I just
- went from there I think that bottom line intellectual curiosity and just a willingness to put
- in the work and to think hard about specific problems and try to be as objective as possible is what allowed me
- to make more accurate forecasts and others within the pool I wouldn't necessarily say that you know what we
- did or what I did as an individual is the best possible at forecasting because they're you know can be so many more
- improvements I I think in terms of how much you know about a specific subject you can always improve your level of
- knowledge I think you can always improve you know how you're you're specifically
- viewing a situation how that situation could potentially evolve so having a greater understanding of how humans
- interact with each other relate to each other the political contours of specific
- situations and events those are all things that you can gain greater knowledge on and get better at
- forecasting in so yeah yeah being open-minded and being open-minded enough to realize that you need to remain open
- minded I think are some of the keys to being you know for for my own forecasting performance
- so I really had three general rules when I made forecasts especially when I made
- my first forecast on a new question or a situation I'd never seen before so the first thing I would say is to be a good
- forecasters you have to be you have to hold strong opinions weekly and what I mean by that is that you do all of your
- homework up front and you really present a good case for why you feel a certain way on a specific question and defending
- your probability probability estimate at that point but when you recognize that somebody else has more information or
- better information than you having the ability to change your mind swiftly to that new forecast I think that was one
- of the keys to why I was able to you know improve my performance over time I think many people really get stuck on
- their initial forecast and they fall in love with it and wind up becoming going into a defensive Crouch when it comes to
- defending their opinion whereas I was on my team sort of notorious for being able
- to switch from one a very hard position all the way to the opposite when I saw new information and come up that led me
- to do that the second thing is to be willing to put in the homework and to put in the effort to understand a
- situation go beyond the Wikipedia page and to go beyond the initial couple of news articles and to really try to
- understand you know what is it what is it about Boko Haram and their composition that you know is allowing
- them to make the kinds of military gains that there that we're seeing and how fragile or stable are those military
- gains compared to other like organizations and to you know not just to say Oh Boko Haram looks like every
- other organization that I've encountered to this point but to say to really try to understand what's going on there and
- to contextualize that appropriately and I think the the third thing is to have in your mind the kinds of
- psychological and cognitive biases that you could potentially fall prey to and to be able to overcome those by you know
- listening to your teammates by self-critique and to recognize that you know whatever forecast and argument that
- you're putting forward now you should be able to alter it or change it or improve
- it in light of new information so you know keeping in mind the cognitive biases that really impact and influence
- and reduce our accuracy and to consciously try to D bias them I think you could really do two things
- to become a good forecaster and one eye one is to read and not just read say Phil's book super forecasting or Dan
- economies book Thinking Fast and Slow which I think many of the forecasters who excelled in torment have read and
- done I also think that you know reading say histories like the guns of august or
- books about bureaucracy by james q wilson and others really improves your your knowledge base and gives you a
- better context for looking at situations and being able to figure out whether there are any commonalities or patterns
- there that you can pick up on and that could potentially apply to future situations that look like that so being
- well-read is I think a contributor to forecasting success the second thing is to just to practice don't get hung up on
- wrong forecasts that you make initially you know don't don't get overly you know
- sensitive to those results but to approach forecasting as something that you can improve on and have that growth
- mindset when it comes to making better forecasts and so from there you're able to say okay I start at some baseline
- level I got some feedback tells me I should improve an XY and Z and to really make a concerted effort to do that
- through practice I think being a forecaster and being a researcher are similar and different I
- think that one of the great things about being a forecaster is that we really weren't constrained by any of the kind
- of customs or sociology around for a custom because we were the ones coming up with that and so we were able to
- explore and be very free in how we approach forecasting whereas I think research while you have some freedom in
- the hypotheses that you are tackling a lot of the methodology and the structure around writing papers and peer review
- and submissions is very much rigid and you must follow the the specific process so i think that that the highlights a
- major difference in forecasting versus doing the research in that the research seem to be much more process oriented
- although obviously there there's an outcome component to it whereas when when we were doing strictly forecasting
- really people only care that we were able to come up with the right answers rather than you know how exactly we we
- got there so yeah they're different they're different animals you
Brief Summary
The episode discusses forecasting techniques and cognitive biases, emphasizing research and adaptability for improved accuracy.
Key points
- The Importance of Curiosity. Intellectual curiosity and hard work lead to better forecasting accuracy.
- Three Rules for Forecasting. Strong opinions, thorough research, and awareness of biases are essential for forecasters.
- The Difference Between Research and Forecasting. Forecasting allows for more freedom compared to the rigid structure of research.
Episode highlights
- The Importance of CuriosityIntellectual curiosity and hard work lead to better forecasting accuracy.“Intellectual curiosity and willingness to work are key to accurate forecasts.”1:02Feb 25, 2016
- Three Rules for ForecastingStrong opinions, thorough research, and awareness of biases are essential for forecasters.“Hold strong opinions weakly; be ready to change your mind.”2:20Feb 25, 2016
- The Difference Between Research and ForecastingForecasting allows for more freedom compared to the rigid structure of research.“They’re different animals.”8:31Feb 25, 2016
Tension
40/ 100Low tension





