RUS  ENG
Full version
JOURNALS // Vestnik Sankt-Peterburgskogo Universiteta. Seriya 10. Prikladnaya Matematika. Informatika. Protsessy Upravleniya // Archive

Vestnik S.-Petersburg Univ. Ser. 10. Prikl. Mat. Inform. Prots. Upr., 2024 Volume 20, Issue 2, Pages 231–243 (Mi vspui621)

Computer science

Multimodal ensemble neural network system for skin cancer detection on heterogeneous dermatological data

U. A. Lyakhova, P. A. Lyakhov

North-Caucasus Federal University, 1, Pushkiną ul., Stavropol, 355017, Russian Federation

Abstract: Today, skin cancer is one of the leading causes of death in the world. Diagnosing skin cancer early is critical to increasing potential survival. Therefore, it is relevant to develop high-precision intelligent auxiliary diagnostic systems for detecting skin cancer in the early stages. Ensemble learning is one of the current and promising methods for increasing the accuracy of intelligent classification systems by reducing the dispersion and variability of predictions of individual components of the overall system. The work proposes an ensemble intelligent system for analyzing heterogeneous dermatological data based on multimodal neural networks. The accuracy of the developed ensemble system was 85.92 %, which is 1.85 percentage points higher than the average accuracy of individual multimodal architectures for classifying heterogeneous dermatological data. The developed system can be used as a high-precision auxiliary diagnostic tool to help make a medical decision, which will increase the chance of early detection of pigmented oncological pathologies.

Keywords: multimodal neural network, ensemble neural network, machine learning, heterogeneous data, dermatological images, pigmented skin lesions, skin cancer, melanoma.

UDC: 004.891.3

MSC: 68T07

Received: October 2, 2023
Accepted: March 12, 2024

DOI: 10.21638/spbu10.2024.208



© Steklov Math. Inst. of RAS, 2024