A more detailed idea of Optimization, especially Progress as optimization. In this thinking there are two ways to continue optimizing:

“But if you want to know why I might be reluctant to extend the graph of biological and economic growth over time, into the future and over the horizon of an AI that thinks at transistor speeds and invents self-replicating molecular nanofactories and improves its own source code, then there is my reason: you are drawing the wrong graph, and it should be optimization power in versus optimized product out, not optimized product versus time.” (Eliezer Yudkowsky, Rationality)

Rethinking optimization over time to optimization over “optimization power in” is interesting. Relates to Progress as optimization and Societal optimization power changes with time. Optimization power in versus optimized product out may be an argument against Inclinism.

Progress as optimization

“But if you want to know why I might be reluctant to extend the graph of biological and economic growth over time, into the future and over the horizon of an AI that thinks at transistor speeds and invents self-replicating molecular nanofactories and improves its own source code, then there is my reason: you are drawing the wrong graph, and it should be optimization power in versus optimized product out, not optimized product versus time.” (Eliezer Yudkowsky, Rationality)

Rethinking optimization over time to optimization over “optimization power in” is interesting. Relates to Progress as optimization and Societal optimization power changes with time. Optimization power in versus optimized product out may be an argument against Inclinism.

Of course, this does not mean things are as good as they should be, or that progress trends could not be improved or sped up. Progress as optimization.

Progress as optimization