RUS  ENG
Full version
JOURNALS // Numerical methods and programming // Archive

Num. Meth. Prog., 2012 Volume 13, Issue 4, Pages 139–145 (Mi vmp80)

Программирование

A model of stream processing of experimental data in distributed systems

V. F. Shchapov, A. G. Masich, G. F. Masich

Institute of Continuous Media Mechanics UB RAS, Perm

Abstract: Modern experimental stands generate long-lasting and intense data streams. Limited computing resources of stands and increasing the accuracy requirements of algorithms make it impossible to provide a local processing. However, a high bandwidth optical lambda networks allows one to transfer calculations to remote supercomputers. It is extremely important to organize an efficient parallelism in all components of the distributed system. This paper considers a model of stream processing of experimental data and focuses on the use of high-speed fiber-optic long-distance data networks for communication of experimental stands with high-performance computing systems. This work was supported by the Russian Foundation for Basic Research (project 11-07-96001-p-ural-a) and Ural Branch of Russian Academy of Sciences (project 12-П-1-2012). The paper was recommended for publication by the Program Committee of the International Scientific Conference “Scientific services in the Internet: search for new solutions” (http://agora.guru.ru/abrau).

Keywords: experimental stand; supercomputer; high-speed optic network; protocol; BDP; distributed computing; stream data processing.

UDC: 004.271.3

Received: 16.09.2012



© Steklov Math. Inst. of RAS, 2025