Probabilistic thinking helps avoid type errors
When our beliefs are quantitative ( A belief is a degree of certainty|probabilities) rather than qualitative (binary true or false), we are able to separate and identify what level our beliefs represent more easily.
For example, I believe snow is white with some probability, say 90%. I also may believe that “with 90% probability, snow is white” is one of my beliefs with a probability of 99.9% (because I have high confidence that I understand my own thoughts). Since we aren’t assigning binary values to these concepts, it is easier for us to see that we have different certainties about these concepts.
(One can get into Deductive thinking here, since Words are pointers to concept-space and if one believes that the Concept-space for “thoughts” and the set of all things I think are the exact same, or something like that. If we realize we are only thinking deductively, then it likely will serve us to Focus on outcomes not definitions.)
↑ 3 References
“Contrast this probabilistic situation to the qualitative reasoning where I just believe that snow is white, and believe that I believe that snow is white, and believe “‘snow is white’ is true,” and believe “my belief ‘“snow is white” is true’ is correct,” etc. Since all the quantities involved are 1, it’s easy to mix them up. Yet the nice distinctions of quantitative reasoning will be short-circuited if you start thinking “‘“snow is white” with 70% probability’ is true,” which is a type error. It is a true fact about you, that you believe “70% probability: ‘snow is white’”; but that does not mean the probability assignment itself can possibly be “true.” The belief scores either -0.51 bits or -1.73 bits of accuracy, depending on the actual state of reality.” (Eliezer Yudkowsky, Rationality)
“Contrast this probabilistic situation to the qualitative reasoning where I just believe that snow is white, and believe that I believe that snow is white, and believe “‘snow is white’ is true,” and believe “my belief ‘“snow is white” is true’ is correct,” etc. Since all the quantities involved are 1, it’s easy to mix them up. Yet the nice distinctions of quantitative reasoning will be short-circuited if you start thinking “‘“snow is white” with 70% probability’ is true,” which is a type error. It is a true fact about you, that you believe “70% probability: ‘snow is white’”; but that does not mean the probability assignment itself can possibly be “true.” The belief scores either -0.51 bits or -1.73 bits of accuracy, depending on the actual state of reality.” (Eliezer Yudkowsky, Rationality)