RUS  ENG
Full version
JOURNALS // Zapiski Nauchnykh Seminarov POMI // Archive

Zap. Nauchn. Sem. POMI, 2021 Volume 499, Pages 129–136 (Mi znsl7048)

II

Recovering word forms by context for morphologically rich languages

A. M. Alekseeva, S. I. Nikolenkoab

a St. Petersburg Department of Steklov Institute of Mathematics, St. Petersburg, Russia
b St. Petersburg State University, 7/9 Universitetskaya nab., St. Petersburg, 199034 Russia

Abstract: In this work, we focus on “sentence-level unlemmatization”, the task of generating a grammatical sentence given a lemmatized one, which can usually be easily done by humans. We treat this setting as a machine translation problem and – as a first try – apply a sequence-to-sequence model to the texts of Russian Wikipedia articles, evaluate the effect of the different training sets sizes quantitatively and achieve the BLUE score of 67,3 using the largest training set available. We discuss preliminary results and flaws of traditional machine translation evaluation methods for this task and suggest directions for future research.

Key words and phrases: deep learning, natural language processing, morphological agreement, machine translation.

UDC: 004.85

Received: 02.10.2020

Language: English



© Steklov Math. Inst. of RAS, 2024