Motoring: Should we trust self-driving cars?

In theory, removing the human from the loop should make roads significantly safer. But is that the reality?