DRIVE: Deep Reinforced Accident Anticipation with Visual Explanation

ICCV 2021

[Paper], [Code]

Wentao Bao 1,2*, Qi Yu 2*, Yu Kong 1*

1ActionLab, 2MiningLab, *Rochester Institute of Technology

Please watch the video if Youtube doesn't work with you.



Traffic accident anticipation aims to accurately and promptly predict the occurrence of a future accident from dashcam videos, which is vital for a safety-guaranteed self-driving system. To encourage an early and accurate decision, existing approaches typically focus on capturing the cues of spatial and temporal context before a future accident occurs. However, their decision-making lacks visual explanation and ignores the dynamic interaction with the environment. In this paper, we propose Deep ReInforced accident anticipation with Visual Explanation, named DRIVE. The method simulates both the bottom-up and top-down visual attention mechanism in a dashcam observation environment so that the decision from the proposed stochastic multi-task agent can be visually explained by attentive regions. Moreover, the proposed dense anticipation reward and sparse fixation reward are effective in training the DRIVE model with our improved reinforcement learning algorithm. Experimental results show that the DRIVE model achieves state-of-the-art performance on multiple real-world traffic accident datasets.




If you find our work helpful to your research, please cite:

     author = {Bao, Wentao and Yu, Qi and Kong, Yu},
     title = {{DRIVE}: Deep Reinforced Accident Anticipation with Visual Explanation},
     booktitle = {International Conference on Computer Vision (ICCV ’20)},
     month = {October},
     year = {2021}