u/Civil-Interaction-76

As AI systems become more advanced, more and more decisions will be made by systems that optimize for specific goals: profit, efficiency, engagement, performance, growth.

But optimization is not the same thing as direction.

Optimization answers the question “how to get more,” but direction answers the question “where are we going?”

In the future, we may have powerful systems optimizing different parts of society - markets, media, transportation, finance, even government systems.

So I’m wondering:

In a world increasingly run by optimizing systems, who will set the direction, not just the optimization?