“But if you want to know why I might be reluctant to extend the graph of biological and economic growth over time, into the future and over the horizon of an AI that thinks at transistor speeds and invents self-replicating molecular nanofactories and improves its own source code, then there is my reason: you are drawing the wrong graph, and it should be optimization power in versus optimized product out, not optimized product versus time.” (Eliezer Yudkowsky, Rationality)

Rethinking optimization over time to optimization over “optimization power in” is interesting. Relates to Progress as optimization and Societal optimization power changes with time. Optimization power in versus optimized product out may be an argument against Inclinism.