“Regarding Science as a mere approximation to some probability-theoretic ideal of rationality . . . would certainly seem to be rational. There seems to be an extremely reasonable-sounding argument that Bayes’s Theorem is the hidden structure that explains why Science works. But to subordinate Science to the grand schema of Bayesianism, and let Bayesianism come in and override Science’s verdict when that seems appropriate, is not a trivial step! Science is built around the assumption that you’re too stupid and self-deceiving to just use Solomonoff induction. After all, if it was that simple, we wouldn’t need a social process of science . . . right? So, are you going to believe in faster-than-light quantum “collapse” fairies after all? Or do you think you’re smarter than that?” (Eliezer Yudkowsky, Rationality)
^9281a1