Chang Welton SF

Knowledge at Wharton

Ask about Knowledge at Wharton

Read the full transcriptHide the full transcript
  1. I first got introduced to the forecast ra by a long time mine at Dartmouth been Valentino who is
  2. a political scientist and he alerted me to an opportunity to forecast with the good judgment project and this was right
  3. around the time when i was leaving baghdad iraq after my second tour there and i was looking for some way of doing
  4. forecasting because i've been something that I've been interested in for for a while and that's why been introduced me
  5. to this idea and you know I the timing worked out as well I was able to come back to the United States and that was
  6. right around the time the the first year of the tournament kicked off and I just
  7. went from there I think that bottom line intellectual curiosity and just a willingness to put
  8. in the work and to think hard about specific problems and try to be as objective as possible is what allowed me
  9. to make more accurate forecasts and others within the pool I wouldn't necessarily say that you know what we
  10. did or what I did as an individual is the best possible at forecasting because they're you know can be so many more
  11. improvements I I think in terms of how much you know about a specific subject you can always improve your level of
  12. knowledge I think you can always improve you know how you're you're specifically
  13. viewing a situation how that situation could potentially evolve so having a greater understanding of how humans
  14. interact with each other relate to each other the political contours of specific
  15. situations and events those are all things that you can gain greater knowledge on and get better at
  16. forecasting in so yeah yeah being open-minded and being open-minded enough to realize that you need to remain open
  17. minded I think are some of the keys to being you know for for my own forecasting performance
  18. so I really had three general rules when I made forecasts especially when I made
  19. my first forecast on a new question or a situation I'd never seen before so the first thing I would say is to be a good
  20. forecasters you have to be you have to hold strong opinions weekly and what I mean by that is that you do all of your
  21. homework up front and you really present a good case for why you feel a certain way on a specific question and defending
  22. your probability probability estimate at that point but when you recognize that somebody else has more information or
  23. better information than you having the ability to change your mind swiftly to that new forecast I think that was one
  24. of the keys to why I was able to you know improve my performance over time I think many people really get stuck on
  25. their initial forecast and they fall in love with it and wind up becoming going into a defensive Crouch when it comes to
  26. defending their opinion whereas I was on my team sort of notorious for being able
  27. to switch from one a very hard position all the way to the opposite when I saw new information and come up that led me
  28. to do that the second thing is to be willing to put in the homework and to put in the effort to understand a
  29. situation go beyond the Wikipedia page and to go beyond the initial couple of news articles and to really try to
  30. understand you know what is it what is it about Boko Haram and their composition that you know is allowing
  31. them to make the kinds of military gains that there that we're seeing and how fragile or stable are those military
  32. gains compared to other like organizations and to you know not just to say Oh Boko Haram looks like every
  33. other organization that I've encountered to this point but to say to really try to understand what's going on there and
  34. to contextualize that appropriately and I think the the third thing is to have in your mind the kinds of
  35. psychological and cognitive biases that you could potentially fall prey to and to be able to overcome those by you know
  36. listening to your teammates by self-critique and to recognize that you know whatever forecast and argument that
  37. you're putting forward now you should be able to alter it or change it or improve
  38. it in light of new information so you know keeping in mind the cognitive biases that really impact and influence
  39. and reduce our accuracy and to consciously try to D bias them I think you could really do two things
  40. to become a good forecaster and one eye one is to read and not just read say Phil's book super forecasting or Dan
  41. economies book Thinking Fast and Slow which I think many of the forecasters who excelled in torment have read and
  42. done I also think that you know reading say histories like the guns of august or
  43. books about bureaucracy by james q wilson and others really improves your your knowledge base and gives you a
  44. better context for looking at situations and being able to figure out whether there are any commonalities or patterns
  45. there that you can pick up on and that could potentially apply to future situations that look like that so being
  46. well-read is I think a contributor to forecasting success the second thing is to just to practice don't get hung up on
  47. wrong forecasts that you make initially you know don't don't get overly you know
  48. sensitive to those results but to approach forecasting as something that you can improve on and have that growth
  49. mindset when it comes to making better forecasts and so from there you're able to say okay I start at some baseline
  50. level I got some feedback tells me I should improve an XY and Z and to really make a concerted effort to do that
  51. through practice I think being a forecaster and being a researcher are similar and different I
  52. think that one of the great things about being a forecaster is that we really weren't constrained by any of the kind
  53. of customs or sociology around for a custom because we were the ones coming up with that and so we were able to
  54. explore and be very free in how we approach forecasting whereas I think research while you have some freedom in
  55. the hypotheses that you are tackling a lot of the methodology and the structure around writing papers and peer review
  56. and submissions is very much rigid and you must follow the the specific process so i think that that the highlights a
  57. major difference in forecasting versus doing the research in that the research seem to be much more process oriented
  58. although obviously there there's an outcome component to it whereas when when we were doing strictly forecasting
  59. really people only care that we were able to come up with the right answers rather than you know how exactly we we
  60. got there so yeah they're different they're different animals you

Brief Summary

The episode discusses forecasting techniques and cognitive biases, emphasizing research and adaptability for improved accuracy.

Key points

  • The Importance of Curiosity. Intellectual curiosity and hard work lead to better forecasting accuracy.
  • Three Rules for Forecasting. Strong opinions, thorough research, and awareness of biases are essential for forecasters.
  • The Difference Between Research and Forecasting. Forecasting allows for more freedom compared to the rigid structure of research.

Tension

40/ 100Low tension

Related episodes