RUS  ENG
Full version
JOURNALS // Vestnik Sankt-Peterburgskogo Universiteta. Seriya 10. Prikladnaya Matematika. Informatika. Protsessy Upravleniya // Archive

Vestnik S.-Petersburg Univ. Ser. 10. Prikl. Mat. Inform. Prots. Upr., 2024 Volume 20, Issue 1, Pages 20–33 (Mi vspui607)

Computer science

Synthetic data generation methods for training neural networks in the task of segmenting the level of crop nitrogen status in images of unmanned aerial vehicles in an agricultural field

A. E. Molina, I. S. Blekanova, E. P. Mitrofanovab, O. A. Mitrofanovaba

a St. Petersburg State University, 7–9, Universitetskaya nab., St. Petersburg, 199034, Russian Federation
b Agrophysical Research Institute, 14, Grazhdansky pr., St. Petersburg, 195220, Russian Federation

Abstract: This study is devoted to the automatization of the image masks' construction of large-sized agricultural objects in precision farming tasks for training neural network methods for crop's nitrogen status analysis using georeferenced images. The scientific direction is extremely relevant because it allows to automate and replace the manual process of data labeling, significantly reducing the cost of preparing training samples. In the paper, four new synthetic data generation methods are proposed for training neural networks aimed at UAV image segmentation by the level of crop nitrogen supply on an agricultural field. In particular, the paper gives a description of synthetic data generation algorithms based on nitrogen covering with lines, parabolas, and areas. Experiments were carried out to test and evaluate the quality of these algorithms using eight modern image segmentation methods: two classical machine learning methods (Random Forest and XGBoost), four convolutional neural network methods based on U-Net architecture, and two transformers (TransUnet and UnetR). The results showed that two algorithms based on areas gave the best accuracy for convolutional neural networks and transformers — 98–100 %. Classical machine learning methods showed very low values for all quality metrics — 27–44 %.

Keywords: nitrogen level segmentation, deep learning, machine learning, synthetic data generation, UAV images, remote sensing data labeling, smart agriculture.

UDC: 004.93

MSC: 93B03

Received: November 15, 2023
Accepted: December 26, 2023

DOI: 10.21638/11701/spbu10.2024.103



© Steklov Math. Inst. of RAS, 2024