Published on July 25, 2025 6:43 PM GMT
In this comment thread on the 2021 post “A Defense of Functional Decision Theory”, @So8res wrote:
...Also, just to be clear, you’re aware that these are two different internally-consistent but contradictory theories of how to evaluate counterfactuals? Like, we can be pretty confident that there’s no argument a CDT agent can hear that causes them to wish to adopt FDT counterfactuals, and vice versa. Humans come equipped with both intuitions (I can give you other problems that pump the other intuitions, if you’d like), and we have to find some other way to arbitrate the conflict.
Following up on my reply that I didn’t know what he was talking about, he recommended some reading:
The canonical explanatory text is the FDT paper (PDF warning) (that the OP is responding to a critique of, iirc), and there’s a bunch of literature on LW (maybe start at the wiki page on UDT? Hopefully we have one of those) exploring various intuitions. If you’re not familiar with this style of logic, I recommend starting there (ah look we do have a UDT wiki page). I might write up some fresh intuition pumps later, to try to improve the exposition. (We’ve sure got a lot of exposition if you dig through the archives, but I think there are still a bunch of gaps.)
I followed both of those links, and was not enlightened. The linked FDT paper had this bit:
In short, CDT and FDT both construct counterfactuals by performing a surgery on their world-model that breaks some correlations and preserves others, but where CDT agents preserve only causal structure in their hypotheticals, FDT agents preserve all decision-relevant subjunctive dependencies in theirs.
(This follows a rather technical section, which I have little confidence in having understood correctly.)
Has the dichotomy that @So8res refers to been clearly explained anywhere? If not—can anyone explain it now? The relevant questions are:
- What are the “two different internally-consistent but contradictory theories of how to evaluate counterfactuals”?What are the intuitions for each (which humans come equipped with)?What problems pump those intuitions?
Discuss