Our Coming Robot Overlords
The recent oil spill in the Gulf has prompted a great deal of wringing of hands – how do such disasters happen? David Brooks discusses in the New York Times that the cause is primarily due to the fact that our modern technological civilization is becoming too complex for us to manage adequately. The Deepwater Horizon oil rig is just one example of a piece of technology that is beyond the mastery of any single person. But there are also nuclear power plants, computer operating systems, jet airliners, financial systems, operating rooms, and numerous other examples.
Brooks concludes:
So it seems important, in the months ahead, to not only focus on mechanical ways to make drilling safer, but also more broadly on helping people deal with potentially catastrophic complexity. There must be ways to improve the choice architecture — to help people guard against risk creep, false security, groupthink, the good-news bias and all the rest.
This seems reasonable. Certainly we need to get better at managing such complexity, by having clear lines of authority and responsibility, proper risk assessment, and a thorough understanding of group dynamics.






