We document and discuss two different modes of evolution across multiple systems, optimization and expansion. The former suffices in systems whose size and interactions do not change substantially over time, while the latter is a key property of open-ended evolution, where new players and interaction types enter the game. We first investigate systems from physics, biology, and engineering and argue that their evolutionary optimization dynamics is the cumulative effect of multiple independent events, or quakes, which are uniformly distributed on a logarithmic time scale and produce a decelerating fitness improvement when using the appropriate independent variable. The appropriate independent variable can be physical time for a disordered magnetic system, the number of generations for a bacterial system, or the number of produced units for a particular technological product. We then derive and discuss a simple microscopic theory that explains the nature of the involved optimization processes, and provide simulation results as illustration. Finally, we explore the evolution of human culture and technology, using empirical economic data as a proxy for human fitness. Assuming the overall dynamics is a combined optimization and expansion process, the two processes can be separated and quantified by superimposing the mathematical form of an optimization process on the empirical data and thereby transforming the independent variable. This variable turns out to increase faster than any exponential function of time, a property likely due to strong historical changes in the web of human interactions and to the associated increase in the amount of available knowledge. A microscopic theory for this time dependence remains, however, a challenging open problem.