When "self-driving" cars were first getting some hype back in ~2015 or so, I told people who asked me that I didn't think they'd be safe, and that I wished the same money were being invested in driver-assistance systems instead.
At the time, advocates were claiming that self-driving cars would be safer than human drivers.
We now have both self-driving cars and some nifty new driver assistance things, and it turns out that the self-driving cars are in fact being developed by corporations whose attention to the bottom line results in danger to others on the road pretty regularly. I don't actually have stats here for whether they're "safer than human drivers" or not, but the opportunity for one bad software update to make *all* self-driving cars dangerous at once kinda makes me doubt that.
Here's an example of Waymo cars getting "more aggressive" as they try to balance between being too timid and obstructing traffic (including emergency vehicles) and being too dangerous:
https://archive.ph/JJuGv
Here's another example of passing stopped schoolbusses leading to a software recall:
https://abcnews.go.com/GMA/News/waymo-issue-voluntary-software-recall-after-close-calls/story?id=128207776
In the first article, Waymo claims 91% fewer serious accidents per mile. Obviously an independent audit would be actually trustworthy, but even if we take that claim at face value, it's meaningless if an update tomorrow causes 100,000 accidents.
Note that they could be using better engineering practices, and the fact that they aren't shows that they don't care enough about the risks. They could be deploying new software versions incrementally and slowly, letting new versions rack up lots of miles only on a few vehicles before pushing them to a fleet. The should also have the equivalent of a simulation unit test for "schoolbus is stopped, what do?" and if a software version fails that test, it doesn't make it to the fleet. Clearly they don't have that.
I feel pretty vindicated in my earlier prediction that this tech is a bad idea in the hands of the current advocates.
@inthehands@hachyderm.io
