I'm wondering what the driver seat would look like. Would it be empty with the steering wheel moving, or would there be a box sitting there covering that side?
I'm assuming the normal controls would still be there, in case the passenger needed to direct the car if it went off course.
People might feel more comfortable if there's a humanoid robot sitting in the drivers seat. I'm sure there's similar examples of that elsewhere but I just can't think of one at the moment.
So the thing here is a possibly incorrect assumption that the passenger was qualified to operate a manually steered car. Most people wouldn't bother to learn if it wasn't required. Similarly, part of the benefit of self driving cars is the mobility it gives the disabled. The elderly, whose licences have been revoked for being unable to drive properly and the blind are both demographics a self driving car would be nothing short of a miracle for.
There would initially be overrides, but those would vanish in fairly short order as the perception shifted towards humans being the horrible drivers that they are.
As for that last bit, no. That's as silly as putting a big, wheeled, metal horse out in the front of an automobile. It may be a bit weird to see this strange, newfangled device moving without a horse to pull it, but only to those people who haven't seen more than 3 automobiles in their lives. Not having a driver would become the new normal within only half a decade or so.
The big problem when the most accidents will happen will probably be during the transition. The biiggest chance an automated car has of making a mistake is when a human is involved. Once there are fewer people driving manually everything will be far smoother, everything is far more predictable when the computers don't have to go into their "What if the guy in front of me does something stupid" routine.
But even during that transition phase I wouldn't be surprised if traffic accidents still go down. Even when the unexpected happens computers have far far better reaction times than any human in the world, and they will almost always react in the most rational way possible where a human in a quick reaction moment may make the wrong choice. Only times a computer would react incorrectly is when something it wasn't programmed to react to happens.
Current google cars according to statistics seem to be able to respond to basically everything already, and when some edge case does come up the situation will be patched into the system's memory along with what to do probably within a day of it being made public.
And as for jobs lost, it may seem a bit cold but that is one of the costs of progress. People need to adapt to a changing world. Does anybody still cry for all the scribes who lost their jobs when the printing press was invented?
Thing is though, vehicles aren't some mystical unsolved physics problem. Motion of all that stuff is incredibly easily predictable. In the case of awful drivers, self driving cars will basically look like ninjas. They can pull evasive maneuvers and crazy movie drifting shit that no human could possibly pull off, and do so in a full repeatable and reliable manner.
Things like this:
https://www.youtube.com/watch?v=ldKMl8HPu2IOr this:
https://www.youtube.com/watch?v=RY93kr8PaC4 (basically demonstrating the pure-physical simulation approach failing, the pure-reaction based approach failing, and the success of an algorithm that takes both into account, essentially modifying a physical simulation on the fly with dynamic reaction to observed motion)
There could basically be an entire highway filled with cars out to get you specifically and all you would probably get would be the most exciting ride of your life.
And yeah, jobs are only a means to an end. "The economy" is pretty royally screwed either way, since labor and production are almost entirely decoupled at this point; more menial labor tasks won't stop that. But that's just a societal problem, and as such there really aren't solutions outside of societal fixes.