RUS  ENG
Full version
JOURNALS // Zapiski Nauchnykh Seminarov POMI // Archive

Zap. Nauchn. Sem. POMI, 2024 Volume 540, Pages 113–131 (Mi znsl7546)

Tiled physical adversarial patch for no-reference video quality metrics

V. Leonenkovaa, E. Shumitskayaabc, A. Antsiferovabc, D. Vatolinabc

a Lomonosov Moscow State University, Moscow, Russia
b ISP RAS Research Center for Trusted Artificial Intelligence, Ivannikov Institute for System Programming of the RAS, Moscow, Russia
c MSU Institute for Artificial Intelligence, Moscow, Russia

Abstract: Objective no-reference image- and video-quality metrics are crucial in many computer vision tasks. However, state-of-the-art no-reference metrics have become learning-based and are vulnerable to adversarial attacks. The vulnerability of quality metrics imposes restrictions on using such metrics in quality control systems and comparing objective algorithms. Also, using vulnerable metrics as a loss for deep learning model training can mislead training to worsen visual quality. Because of that, quality metrics testing for vulnerability is a task of current interest. In this work we propose a new method for testing quality metrics vulnerability in the physical space. To our knowledge, quality metrics have not previously been tested for vulnerability to this attack; they were only tested in the pixel space. We applied a physical adversarial Ti-Patch (Tiled Patch) attack to quality metrics and did experiments both in pixel and physical space. We also performed experiments on the implementation of physical adversarial wallpaper. The proposed method can be used as additional quality metrics in vulnerability evaluation, complementing traditional subjective comparison and vulnerability tests in the pixel space. The code and adversarial videos for this work are available on GitHub: https://github.com/leonenkova/Ti-Patch.

Key words and phrases: adversarial patch, physical attack, video quality metrics.

Received: 15.11.2024

Language: English



© Steklov Math. Inst. of RAS, 2025