RUS  ENG
Full version
JOURNALS // Informatics and Automation // Archive

Tr. SPIIRAN, 2014 Issue 37, Pages 170–187 (Mi trspy770)

This article is cited in 2 papers

Computer Sign Language Interpretation System Development of Russian Language

Y. S. Manueva, M. G. Grif, A. N. Kozlov

Novosibirsk State Technical University

Abstract: In the article review of the existing systems of computer sign language is provided and their advantages and disadvantages are identified. The synchronic aspect of these systems was considered. The general case of translation (both sides) from sounding Russian on Russian sign language and vice versa is observed. A new method for constructing a semantic unit of computer sign language is proposed. Lexical meanings of words are defined to match the correspondence "word-gesture". Among the many words alternatives based on the semantic analysis algorithm for each word necessary lexical meaning is confirmed. For simple sentence semantic analyses algorithms are developed. A translation method of the Russian text into Russian sign language based on a comparison of syntactic structures is proposed. Relevant library is developed to determine the syntax constructions. To create the architecture of the future system for gesture recognition are examined existing hardware and media programs. It is noted that this stage there is no solution that meets the specified requirements, so to get a more accurate result, it is necessary to use a combination of these systems.

Keywords: Russian sign language; computer sign language interpretation; semantic analysis; syntax constructions; recognizers of sign language.

UDC: 81.322

DOI: 10.15622/sp.37.11



© Steklov Math. Inst. of RAS, 2024