Structural Discrimination and Autonomous Vehicles: Immunity Devices, Trump Cards and Crash Optimisation

TY - GEN

T1 - Structural Discrimination and Autonomous Vehicles

T2 - Immunity Devices, Trump Cards and Crash Optimisation

AU - Liu, Hin-Yan

PY - 2016/10

Y1 - 2016/10

N2 - This paper examines the potential for structural discrimination to be woven into the fabric of autonomous vehicle developments, which remain underexplored and undiscussed. The prospect for structural discrimination arises as a result of the coordinated modes of autonomous vehicle behaviour that is prescribed by its code. This leads to the potential for individuated outcomes to be networked and thereby multiplied consistently to any number of vehicles implementing such a code. The aggregated effects of such algorithmic policy preferences will thus cumulate in the reallocation of benefits and burdens to certain categories of persons in a relatively stable manner. The spectre of implicit structural discrimination is therefore raised by the orderly and stable rearrangement of biases that may be expressed by the controlling algorithm.The potential for a much more pernicious form of active structural discrimination looms with the possibility of crash optimisation impulses in which a protective shield is cast over those individuals in which society may have a vested interest in prioritising or safeguarding. A stark dystopian scenario is introduced to sketch the contours whereby personal beacons signal individual identity, and potentially relative worth, to autonomous vehicles engaging in a crash damage calculus. At the risk of introducing these ideas into the development of autonomous vehicles, this paper hopes to spark a debate to foreclose these eventualities.

AB - This paper examines the potential for structural discrimination to be woven into the fabric of autonomous vehicle developments, which remain underexplored and undiscussed. The prospect for structural discrimination arises as a result of the coordinated modes of autonomous vehicle behaviour that is prescribed by its code. This leads to the potential for individuated outcomes to be networked and thereby multiplied consistently to any number of vehicles implementing such a code. The aggregated effects of such algorithmic policy preferences will thus cumulate in the reallocation of benefits and burdens to certain categories of persons in a relatively stable manner. The spectre of implicit structural discrimination is therefore raised by the orderly and stable rearrangement of biases that may be expressed by the controlling algorithm.The potential for a much more pernicious form of active structural discrimination looms with the possibility of crash optimisation impulses in which a protective shield is cast over those individuals in which society may have a vested interest in prioritising or safeguarding. A stark dystopian scenario is introduced to sketch the contours whereby personal beacons signal individual identity, and potentially relative worth, to autonomous vehicles engaging in a crash damage calculus. At the risk of introducing these ideas into the development of autonomous vehicles, this paper hopes to spark a debate to foreclose these eventualities.

U2 - 10.3233/978-1-61499-708-5-164

DO - 10.3233/978-1-61499-708-5-164

M3 - Article in proceedings

SP - 164

EP - 173

BT - What Social Robots Can and Should Do

PB - IOS Press

CY - Amsterdam

ER -