According to the Disconnection Thesis (Roden 2012; 2014: Chapter 5) a posthuman is an agent descended from some part of the human socio-technical system that has “gone feral”. In its ancestral form, it may have served human ends, or have been narrowly human itself, but (post-disconnection) has accrued values and roles elsewhere.
To date there are no posthumans so we can only guess at their likely powers. But it seems safe to assume that anything capable of cutting out of the human system would need to be at least as flexible and adaptable as humans are themselves.
These powerful entities might be indifferent to humans, but they may not like us at all; or like us in ways we would not like to be liked. They may view us as a threat, or they may be immensely powerful sadists who devote some part of their technological prowess to killing and torturing us. If posthumans are conceivable, so are very bad posthumans.
So can we do some contingency planning to ensure against the emergence of posthuman dark lords? To do this we would need some handle on the kind of current technologies that might induce a dark lord disconnection (DLD). But what kinds of technologies could these be?
It might seem that some technological possibilities can be discerned a priori – by consulting reliable conceptual “intuitions” about the extendible powers of current technologies. For example, a being like Skynet – the genocidal military computer in James Cameron’s Terminator films – seems a plausible occupant of a posthuman timeline; whereas Sauron, the supernatural dark lord of Tolkien’s Lord of the Rings, does not. However, since the work of Saul Kripke in the 1970’s many philosophers have come to accept that there are a posteriori natural possibilities and necessities that are only discoverable empirically. That light has a maximum velocity from any reference frame upsets common sense intuitions about relative motion and could not have been discovered by reflecting on pre-relativistic concepts of light.
Claims about hypothetical technological possibility may be as vulnerable to refutation as naive physics. States like the US and China employ computers to co-ordinate military activities so a Skynet seems the more plausible posthuman antagonist. But the fact that there are computers but no supernatural dark lords does not entail that their capacities could be extended in any way we imagine. Light bulbs exist as well as computers, but maybe a Skynet is no more technologically possible than Byron the Intelligent light bulb in Thomas Pynchon’s fabulist novel Gravity’s Rainbow.
So here’s a thing. Posthuman Possibility Space (the set of technically possible routes to disconnection) may contain a Dark Lord Possibility Sub-Space – the trajectories all of which lead to a DLD! We may not have any reliable indication of what (if anything) belongs to it. But, quite possibly, it is out there, waiting.
Roden, David. 2012. “The Disconnection Thesis”. In The Singularity Hypothesis: A Scientifc and Philosophical Assessment, A. Eden, J. Søraker, J. Moor & E. Steinhart (eds), 281–98. London: Springer.