Wireva

Self-Driving Systems May Increase Road Risk, Experts Warn

Experts warn that increasingly capable driver-assistance systems can breed «automation complacency», leaving drivers unprepared to retake control and raising the risk of collisions.

More capable driver-assistance systems may make roads more dangerous rather than safer, according to experts who warn that drivers are becoming too trusting of technology that still requires their full attention. The phenomenon, known as «automation complacency», occurs when motorists assume an automated system can handle any situation and stop monitoring the road, leaving them unable to intervene when it fails.

The warning arrives as virtually every major carmaker either offers some form of autonomous driving technology or has one in development. Tesla is pressing regulators to allow public purchase of its fully autonomous Cybercab, while mainstream manufacturers are preparing more advanced systems of their own. The concern is that the marketing and capability of these systems are outpacing the legal and practical reality that drivers remain responsible for the vehicle.

Level 2 systems, which include Tesla’s Full Self-Driving feature, still require a human to be attentive and ready to take control at any moment. In the event of a collision, legal liability rests solely with the driver. That distinction has already been learned the hard way. Kyle Shanahan, head coach of the San Francisco 49ers, used Tesla’s FSD for years before crashing head-on into traffic. Speaking at a press conference in August, he described how he wrongly assumed the system was engaged and bent over to pick up his phone. His car veered into the oncoming lane, leaving him with broken bones and a concussion. He took full responsibility and said the crash had changed his thinking about autonomous driving. «When you’re going at 20 miles an hour, and you’re on autopilot, I honestly have zero worries», he said. «That was a good lesson that you can’t ever have zero worries. I think it definitely could be an example for a lot of people.»

Current consumer systems differ greatly from driverless taxis such as those operated by Waymo, yet drivers are already relying on the technology in ways its designers did not intend. Carolyn McBride, a 72-year-old Tesla Model Y owner, says she struggles to see at night and that her car prevented her from hitting a pedestrian. Tesla has leaned into such testimonials, reposting on X the account of a man with cerebral palsy who said his Tesla with FSD allowed him to go wherever he wanted, whenever he wanted. The company has described the system as «a guardian angel for you, and others on the road».

Guy Mangiamele, director of AMCI Testing, which evaluates new car technology, praised Tesla’s advances but cautioned against overconfidence. «Maybe it will take 500 miles or 1,000 miles, but at some point it’s going to get something wrong», he said. «If you’re not 100 percent aware and ready to take control, you’re going to be a danger to yourself and others around you.»

Rivian is preparing to launch its own hands-off system, capable of navigating any well-marked street from point to point. Like Tesla’s FSD, it remains at Level 2, meaning drivers stay responsible and must remain alert. James Philbin, Rivian’s senior vice president for autonomy, frames the technology differently, presenting it as a way to combat driver fatigue rather than compensate for shortcomings. «The biggest danger is actually drivers getting tired», he said. «These systems can dramatically improve that.»

The race towards full autonomy is widening. Ford has announced plans for a Blue Cruise Level 3 system in 2028 that would allow drivers to take their hands off the wheel and their eyes off the road. General Motors is pursuing similar capabilities with its next-generation Super Cruise, and Rivian is following suit. Reaching that point will require significant regulatory changes, and the timelines remain uncertain. Philbin estimates five years or less, while Bryan Reimer, a research scientist at the M.I.T. Center for Transportation and Logistics, offers a more pessimistic view: «It’s decades», he said, «not years».

Same event, other desks

Story file →