Home
Uni-Logo
 

Towards Understanding Adversarial Robustness of Optical Flow Networks

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
Abstract: Recent work demonstrated the lack of robustness of optical flow networks to physical patch-based adversarial attacks. The possibility to physically attack a basic component of automotive systems is a reason for serious concerns. In this paper, we analyze the cause of the problem and show that the lack of robustness is rooted in the classical aperture problem of optical flow estimation in combination with bad choices in the details of the network architecture. We show how these mistakes can be rectified in order to make optical flow networks robust to physical patch-based attacks. Additionally, we take a look at global white-box attacks in the scope of optical flow. We find that targeted white-box attacks can be crafted to bias flow estimation models towards any desired output, but this requires access to the input images and model weights. However, in the case of universal attacks, we find that optical flow networks are robust. Code is available at https://github.com/lmb-freiburg/understanding_flow_robustness.
Paper Supplementary Poster Downloads

Images and movies

 

BibTex reference

@InProceedings{SSB22,
  author       = "S.Schrodi and T.Saikia and T.Brox",
  title        = "Towards Understanding Adversarial Robustness of Optical Flow Networks",
  booktitle    = "IEEE Conference on Computer Vision and Pattern Recognition (CVPR)",
  month        = " ",
  year         = "2022",
  url          = "http://lmbweb.informatik.uni-freiburg.de/Publications/2022/SSB22"
}

Other publications in the database