RUS  ENG
Full version
JOURNALS // Chebyshevskii Sbornik // Archive

Chebyshevskii Sb., 2022 Volume 23, Issue 2, Pages 151–160 (Mi cheb1182)

This article is cited in 1 paper

The construction and analysis of the Russian language models for a cryptographic algorithm research

A. G. Malashina, A. B. Los

National Research University «Higher School of Economics» (Moscow)

Abstract: The article provides a statistical analysis of the properties of lexical and $n$-gram models of the Russian language based on the news text corpus. A specialized corpus of political news articles of recent years has been created, reflecting a narrow area of language use. The token and $n$-gram dictionaries are compiled, the coverage values are found, as well as the values of entropy. Lemmatization of the original text corpus and extrapolation of the dictionary volumes are performed.

Keywords: $n$-gram dictionaries, $n$-gram entropy, meaningful texts.

UDC: 519.722

Received: 30.09.2020
Accepted: 22.06.2022

DOI: 10.22405/2226-8383-2022-23-2-151-160



© Steklov Math. Inst. of RAS, 2025