Published on January 10, 2025 6:13 PM GMT
Some scenarios I can think of, of various levels of realism:
- Currently, more than 100k people die each day, from all sorts of causes, including self-harm. To save every single human life, the aligned AGI may make a decision to mind-upload all humans, even whose who are against it. For an external observer, this may look like an omnicide, especially if the procedure requires destructive scans.A variant scenario: unable to find a solution that prevents humans from killing and harming themselves, the aligned AGI puts all humans into cryo sleep, until a solution is devised. The solution turns out to be a complete removal of privacy. Everyone knows who is dating whom, who is taking bribes, how you look naked, who is planning wars, etc. This solves most societal issues, while creating a lot of suffering for privacy-concerned people.The technological unemployment accelerates. Millions of people become unemployable, the incompetent gov does nothing. This results in a large-scale social unrest. As a solution, the aligned AGI implements a planned economy and redistribution of resources, thus severely limiting property rights. The aligned AGI recognizes the harms of religion, promptly erases all holy books and monuments, and makes religious people non-religious, by some means. A more general variant of the previous scenario: the aligned AGI determines that human cognitive biases are the root cause of many societal ills. The list of the cognitive biases includes the ones associated with romantic love etc. The AGI implements widespread measures to reduce the cognitive biases, effectively changing human nature. A variant scenario: to optimize human potential, the AGI implements mandatory cognitive enhancements, arguing that the improved versions of humans are more aligned with true human values.The aligned AGI stops all wars by causing immense pain to any human who attempts to kill another human. The aligned AGI decides that resurrecting a long-dead human by technological means is as ethical as saving a human life. But the process of resurrection requires creating trillions of digital minds, many of which are suffering, and the process may take millions of years. This massively increases the total amount of suffering in the universe, an S-risk scenario. Yet it saves billions of lives.The aligned AGI learns the root causes of gender dysphoria, and creates a drug that cures it (as in making the person happy with the genitals their got from birth). This greatly reduces suffering among the transgender people who take the drug, but creates a massive backlash from LGBT community and allies. To prevent existential risks, the aligned AGI significantly restricts human technological development and research in many domains.To reduce racism, the aligned AGI makes all humans of the same skin color. To reduce animal suffering and global warming, the AGI bans meat consumption. The AGI delivers the modern technology to uncontacted tribes, to reduce suffering among them.
Discuss
