RUS  ENG
Full version
JOURNALS // Computer Optics // Archive

Computer Optics, 2023 Volume 47, Issue 6, Pages 980–990 (Mi co1202)

IMAGE PROCESSING, PATTERN RECOGNITION

Copyright protection of deep image classification models

Yu. D. Vybornova, D. I. Ulyanov

Samara National Research University

Abstract: With the growing number of tasks solved using deep learning methods, the need for protection against unauthorized distribution of the intellectual property such as pre-trained models of deep neural networks is growing. To date, one of the most common ways to protect copyright in the digital space is through embedding digital watermarks. When solving the problem of watermark embedding, an important criterion is the preservation of the model prediction accuracy after introducing the protective information. In this paper, we propose a method for embedding digital watermarks into image classification models based on adding images obtained by superimposing pseudo-holograms on images of the original dataset to the training set. A pseudo-hologram is an image synthesized on the basis of a given binary sequence by arranging pulses for bit encoding in the spectral region. Results of the experimental study show that the proposed method allows one to maintain the classification quality, while also retaining its performance regardless of the architecture of the protected neural network. The conducted series of attacks on protected models show that attempts of an attacker to completely remove the watermark will almost inevitably lead to a significant loss in the model prediction quality. The results of the experiments also include recommendations on the choice of method parameters, such as the size of the trigger and training sets, as well as the length of sequences encoded by pseudo-holograms.

Keywords: image classification models, digital watermarking, copyright protection, pseudo-holographic images

Received: 16.03.2023
Accepted: 09.08.2023

DOI: 10.18287/2412-6179-CO-1302



© Steklov Math. Inst. of RAS, 2024