@RAOF @mcc That sounds like Newcomb’s Paradox, and it’s older than Yudkowsky is.

https://en.wikipedia.org/wiki/Newcomb%27s_paradox