Published on May 7, 2025 3:20 PM GMT
This is a crosspost of a post from my blog, Metal Ivy. The original is here: A Disciplined Way To Avoid Wireheading.
What is wireheading?
The term wireheading comes from the observation that if you put a wire in someone’s brain such that it is near their brain’s pleasure (or craving) center, and give them a lever that when pressed activates the current through the wire, they will repeat that action forever, to the point of dying from starvation. Conditional on them trying it once, of course. These experiments have been performed on mice, dolphin, monkeys, and in the distant unethical annals of the 1970s, humans.
Personally, though I am not alone in this view, I see wireheading not as an independent phenomenon, but instead the edge of a spectrum. These neurons were not created by evolution for some other task that is being tricked by wireheading to cause cravings to pull a lever. They were evolved precisely to give you a craving to perform an action to get dopamine. It just didn’t want you to do it quite so directly (if you oppose the framing of “goals” for evolution, take it as a rhetorical device, or call it Moloch[1]).
Evolution has many pathways for getting you to do what it wants. The craving mechanism is one of them, but you also have a more stable sense of utility — that sense tells you that, actually, being addicted to pulling a lever to directly stimulate your brain is “bad”. You want to get pleasure in a less direct, more natural way. You don’t want to trick your own brain. The craving and the perceived, externalized utility contradict, especially if you were to reflect on the subject before the first pull of the lever. This article will take the stance that this sense of utility is important, as an axiom, since we find it to be important by its very definition. We do not want it to contradict with our actions, which means we don’t want to stimulate our dopamine secreting neurons so directly.
On the possibility of just not inserting a wire into your brain
Directness is a spectrum, trickiness is a sliding scale and something being natural or not is not well defined. Fentanyl is not as direct as wireheading, but it’s not all that different either. TikTok is further to the left, in this sense. But it can be placed on this same spectrum. The typical activities that you find rewarding in both senses belong on the left extreme.
The only sense in which there is a phase change on this spectrum — a fundamental, qualitative difference — is the point at which the craving overpowers your self control, which I’ll call addiction (regardless of the formal definition of addiction, I think most can agree that repeatedly pressing a lever is the quintessential example of it). But I think even that is not binary. The mice in the wireheading experiments died from starvation, not thirst. They could have been more addicted than they were. The human subject in Moan 1972 (unethical experiment trigger warning) didn’t starve, he just “vigorously” protested disconnection (unfortunately what that means was not expanded upon in the paper).
I’ll argue that there isn’t actually any point at which you should prefer going toward the right of this spectrum. The hedonic treadmill means that whenever you are exposed to a new, more direct method of stimulating yourself with more dopamine, your happiness level will rapidly re-adjust such that you will be just as happy (or unhappy) as before.
As such, even if you are a hedonist, at present it’s not even clear if wireheading would actually make you happier long term, it will just get you very addicted, and very depressed once you stop (and unfortunately, the hedonic treadmill is slower to adjust in the other direction). As such exposing your brain to a new, never seen before level of Septal stimulation is only actually good for you, long term, if it corresponds to a new, never seen before level of actual utility to you, i.e. not rightward on the spectrum described above. So instead of the harm appearing at some arbitrary point, on the fentanyl range, or the wire-in-brain stage, it is “whatever shows your brain a new, never seen before peak of dopamine without a corresponding, never seen before peak of utility”.
How to avoid edging toward the right side of the scale
This situation — where moving to the right side could be as easy as popping a pill, and moving to the left (breaking an addiction) is one of the most challenging activities a human can undertake, is systemically troubling. If you’re a transhumanist and think there’s a chance you will live ~forever, the situation is even worse. You can imagine wireheading as something like a black hole — once you’re inside, you aren’t getting out, and it’s very easy to get pulled closer.
More than this, technology improves. The most addictive drugs today are more addictive than the most addictive drugs of the past, and we’ve found ways to get people addicted to things without direct access to the insides of their body, through a combination of visual and auditory channels (TikTok, its predecessors and its future successors). This trend seems likely to continue.
Still, maybe we shouldn’t be too fatalistic. Most of us don’t go around in constant fear of getting addicted to a new drug. Even when you eat something you’ve never eaten before, you are not concerned that it is going to be uniquely addictive. And technologies occasionally get invented to help push you away from the blackhole, or slow your descent — Ozempic’s craving suppressing properties seem promising. But my empirical observation is that looking at the trend line, we are moving to the right as technology improves. As he describes in his personal diary, Marcus Aurelius was worried about the addictive potential of poetry two millennia ago, and we are now worried about the addictive potential of TikTok, but they are not the same. Those that fall to TikTok today spend more time on it, and feel stronger cravings for it, than Romans felt for poetry.
I think the only way you could be confident that you don’t accidentally move to the right — that the new technology you’re trying isn’t going to shock you with its level of stimulation, and get you addicted, that it isn’t the “next tiktok”, is to not try new technologies as they come out. Wait until you’ve seen evidence they aren’t addictive, or verify that your understanding of the technology is such that you can be confident it is not addictive in advance.
Otherwise I don’t see how you would have avoided the original Coca Cola (which famously contained cocaine) in 1886, or TikTok in 2016 (and you may have tried both these things and not gotten addicted, but you couldn’t have been confident of that, if you originally tried them as they came out). And so I unfortunately find myself pointing in a technology fearing direction in this respect, even being the techno optimist that I am. But this isn’t the only respect in which technology needs to be evaluated, and intuitively you don’t actually want to avoid all new technologies.
The fact that technology usually has real benefits, means that waiting to try a new technology until it is confirmed not addictive (or worth it regardless) is not free. But I think this is a consideration that should be taken into account, because the only way to be sure you don’t move toward the wireheading black hole is to decide on a date (say, today’s date) and to avoid trying new technologies created after that date, unless they are confirmed not addictive.
I personally chose a cutoff date for just new entertainment technologies instead. They have the most potential to be out of distribution addicting, and the least benefit from technological advancement, once you take the hedonic treadmill into account. This is at least a stopgap measure, until we have some technology capable of painlessly stopping a severe addiction, or the depths of audio/visual mediums are fully explored and we are confident that they could never cause something approaching true wireheading.
- ^
Or call it POSIWID, which in my opinion is, in the original, academic sense, is isomorphic to the Moloch concept, though Scott himself disagrees.
Discuss
