An automated vehicle within a controlled environment (say robot forklifts servicing between the stacks of an automated-only warehouse floor) is going to be advantageous compared to the very same system with entirely human controllers. But the safeguards to prevent bad man/machine interactions should probably go so far as to dissallow any pedestrian access down the inter-stack aisles unless the system were specially asked to disallow robo-forklift transit (and possibly sufficiently preventative barriers set up, to maybe both signal that revocation of access and physically gst in the way).
Our roads, however, are not so tightly controlled as the automated warehouse. The problems an automated vehicle has to overcome may start with other autonomous vehicles (inter-vehicle notifications and negotiation might be 'predesigned' into a properly specced vehicle with a wifi-like beacon perhaps) but also passes through manually-controlled vehicles (beacons for which, if they exist, cannot speak for the driver's actual intentions, only its current position and velocity), pedestrians (assumed intelligently aware, for the most part, but requires fully un-negotiated detection), animals (may be intelligent/aware to a lesser degree, but that'd be effectively an exception to the norm) and environment, to name just a few.
Right now, the 'open road' is too open to guarantee that hypersmart and (mostly!) all-seeing vehicles will not be fooled by a swirl of sutumn leaves on the road or somesuch. If not to cause a crash, then to slow down and halt as the vehicle's lidar/camera system inputs are taken as out-of-range taking common-sense beyond mere caution. Almost ensuring zero potential incidents, but also disrupting traffic flow.
But, about the all-seeing: there was the Tesla crash in June (IIRC). The visual systems of the vehicle being allowed to drive 'unattended'1 did not observe a big-rig turning across the road, blending the upper body in with the sky, apparently, so ploughed straight on and under the rear. A person driving with such visual impairment might (admitedly, knowing humans, not as often as they should...) at least have the common sense to know that not being able to see things does not mean that there are no things to see. Maybe the algorithm needs tweaking for additional caution. Maybe all artic trailers need big zebra stripes on them to be seen better in all conditions (except in herds, obviously!). Maybe all trucks should be autonomous such that no road-crossing truck is ever not negotiating its traversal with all traffic within transceiver contact distance?
But, getting from the current human-fallible situation to the machine-perfect future is frought with difficulty in the transition, and probably only asymptotic in the achievement, at least whilst Zion keeps sending out its hovercraft patrols with their pesky EMPs.
1 The owner/nominal-driver, a proponent and enthusiast of the self-driving car was apparently watching a Harry Potter movie and not monitoring his car's 'routine' self-driving behaviour, as Tesla were still recomending its customers do.