Belief in belief
From Lesswrongwiki
As Daniel Dennett observes, where it is difficult to believe a thing, it is often much easier to believe that you ought to believe it. What does it mean to believe that the Ultimate Cosmic Sky is both perfectly blue and perfectly green? The statement is confusing; it's not even clear what it would mean to believe it - what exactly would be believed, if you believed. You can much more easily believe that it is proper, that it is good and virtuous and beneficial, to believe that the Ultimate Cosmic Sky is both perfectly blue and perfectly green. Dennett calls this "belief in belief".
Belief in belief is a situation where a model of the world you claim and believe to have is at odds with a model of the world that explains your actions and drives your anticipation of experience. You are always ready to provide an excuse for the next experiment not supporting your stated belief, because you know the outcome of the experiment in advance, but have to rationalize it in terms of the stated belief. Belief in belief can be seen as a form of compartmentalization, which protects your actual model of the world from insane memes that survive as stated beliefs. Were you to really believe and not just believe in belief, the consequences of error would be much more severe.
Blog posts
- Belief in Belief
- No, Really, I've Deceived Myself
- Belief in Self-Deception
- Modularity, Signaling, and Belief in Belief by Kaj Sotala