Valley of bad rationality
Then I finally reply that my experience so far - even in this realm of merely human possibility - does seem to indicate that, once you sort yourself out a bit and you aren't doing quite so many other things wrong, striving for more rationality actually will make you better off. The long road leads out of the valley and higher than before, even in the human lands.
It has been observed that when someone is just starting to learn rationality, they sometimes appear to be worse off than they were before. Someone else may then allege that after this person learns even more about rationality, they will finally be better off than they were before they started. The period before this improvement is known as "the valley of bad rationality".
- Knowing About Biases Can Hurt People
- Incremental Progress and the Valley
- Reason as memetic immune disorder by Phil Goetz
- Making your explicit reasoning trustworthy by Anna Salamon
- This comment by Yvain on Bayesians vs. Barbarians