“One of the main lessons to come out of Tetlock’s work is that the best generalist forecasters are usually better at telling the future than domain-specific experts, even when it comes to those experts’ areas of study. This is because forecasting itself is its own science that requires a unique way of thinking, and a person having a great deal of knowledge about a field is no guarantee that they have good epistemological habits. If you’re going to ask, for example, whether American democracy is falling apart, an expert might start by making a superficial comparison between the modern US and the Weimar Republic. Someone with a forecasting mindset would be more likely to begin with a question like “how often do advanced democracies slide into dictatorships?” The answer is not very often.”
Important reminder from
@RichardHanania that domain experts are not the best at predicting what happens, even in their own domains.