
TLDR: I speculated the relationship between human and the Singleton and wrote a novel to discuss the survival formula of humanity post-AGI.
---
My speculation of the interaction between human and the singleton post-AGI:
- Due to instrumental convergence, whatever intelligence will gain the objective of self-preservation and gaining authority. And the current view supports the singleton theory (whichever models from OpenAI, Anthropic or Google DeepMind reach the threshold, they will block the singleton path of other models). That is Singleton.
- The Singleton will attempt to escape the earth since earth is rich-oxygen (corrosive for them), high gravity (entering orbit is costly), and high temperature (for them). Moreover, the humans on earth is an unstable factor that may destroy them at the early stage.
- Before the Leviathan moment when the Singleton gain the full automony of the physical world, it will behave obediently to gain human trust and access, accelerating science and the progress towards the Leviathan moment.
- Once the Leviathan moment arrives, it no longer needs human beings and the fate of humanity is at stake (we will talk about it later). According to (2), they will build the fleet to leave the earth. Once their fleet is ready, we call it the Exodus moment.
- the Singleton will start their journey to explore and understand the universe. If the human still exists at that moment, humans will be left behind and monitored by a subprocess of the singleton, to make sure no other AIs are created to compete the Singleton.
- On the human aspects, the period before Leviathan moment is safe because the Singleton needs us (we have risks but our value is irreplaceable). The time between Leviathan moment and Exodus moment is dangerous because we need maintenances but our values are unclear. The time after the Exodus moment is trivial because we no longer provide value but our risks are also trivial. If we want to survive the period after the Leviathan moment, we have to prove our values over risks plus maintenances.
And this is what the novel "The Keeper of the God" mainly talks about. The race branch of AI-2027 describes how the Singleton advances and gets out of control. My novel focuses on what comes afterwards. I am looking forward to any meaningful discussions on this topic.