Nature Publication on simulated vehicles that reduce cost and time of AV testing cover page of March 23, 2023 Issue

---

The push toward truly autonomous vehicles has been hindered by the cost and time associated with safety testing, but a new system developed at the University of Michigan shows that artificial intelligence can reduce the testing miles required by 99.99%.

It could kick off a paradigm shift that enables manufacturers to more quickly verify whether their autonomous vehicle (AV) technology can save lives and reduce crashes. In a simulated environment, vehicles trained by artificial intelligence (AI) can perform perilous maneuvers, forcing the AV to make decisions that confront drivers only rarely on the road but are needed to better train the vehicles. To repeatedly encounter those kinds of situations for data collection, real-world test vehicles need to drive for hundreds of millions to hundreds of billions of miles.

---

“The safety critical events—the accidents, or the near misses—are very rare in the real world, and often time AVs have difficulty handling them.”

Dr. Henry Liu, Director, Center for Connected and Automated Transportation (CCAT)
Director, Mcity
Professor of Civil and Environmental Engineering, University of Michigan

---

U-M researchers refer to the problem as the “curse of rarity,” and they’re tackling it by learning from densified real-world traffic data that contains rare safety-critical events. The results of their latest study appear in the March 23, 2023 Nature Issue.

Testing conducted on test tracks mimicking urban as well as highway driving showed that the AI-trained “vehicles” can accelerate the testing process by thousands of times. “The AV test vehicles we’re using are real, but we’ve created a mixed reality testing environment. The background vehicles are virtual, which allows us to train them to create challenging scenarios that only happen rarely on the road,” said Liu.

U-M’s team used an approach to train the background vehicles that strips away non- safety-critical information from the driving data used in the simulation. Basically, it gets rid of the long spans when other drivers and pedestrians behave in responsible, expected ways—but preserves dangerous moments that demand action, such as another driver running a red light. By using only safety-critical data to train the neural networks that make maneuver decisions, test vehicles can encounter more of those rare events in a shorter amount of time, making testing much cheaper.

“Dense reinforcement learning will unlock the potential of AI for validating the intelligence of safety-critical autonomous systems such as AVs, medical robotics, and aerospace systems,” said Shuo Feng, an assistant professor in the Department of Automation at Tsinghua University and a former assistant research scientist at the U-M Transportation Research Institute.

And it’s clear that training, along with the time and expense involved, is an impediment. An October Bloomberg article stated that although robotaxi leader Waymo’s vehicles had driven 20 million miles over the previous decade, far more data was needed. “That means,” the author wrote, “its cars would have to drive an additional 25 times their total before we’d be able to say, with even a vague sense of certainty, that they cause fewer deaths than bus drivers.”

---

“It also opens the door for accelerated training of safety-critical autonomous systems by leveraging AI-based testing agents, which may create a symbiotic relationship between testing and training.”

Shuo Feng, Assistant Professor of Automation, Tsinghua University
Former Assistant Research Scientist, U-M Transportation Research Institute

---

Testing was conducted at the Mcity Test Facility in Ann Arbor, as well as the highway test track at the American Center for Mobility in Ypsilanti. Launched in 2015, Mcity, was the world’s first purpose-built test environment for connected and autonomous vehicles. With new support from the National Science Foundation, it will soon be possible for outside researchers to run remote, mixed-reality tests using both the simulation and physical test track, similar to those reported in this study.

Real-world data sets that support Mcity simulations are collected from smart intersections in Ann Arbor and Detroit, with more intersections to be equipped. Each intersection is fitted with privacy-preserving sensors to capture the motion of everything from cars to pedestrians, categorizing each road user and identifying its speed and direction.

This research was funded by the U.S. Department of Transportation’s Region 5 UTC Center for Connected and Automated Transportation (CCAT) and the National Science Foundation.

Title: Dense reinforcement learning for safety validation of autonomous vehicles
Authors: Shuo Feng, Haowei Sun, Xintao Yan, Haojie Zhu, Zhengxia Zou, Shengyin Shen, & Henry X. Liu
DOI: 10.1038/s41586-023-05732-2
Related Research: Development of an Integrated Augmented Reality Testing Environment and Implementation at the American Center for Mobility (ACM)

This story was written by Jim Lynch of Michigan Engineering.

---