RUS  ENG
Full version
JOURNALS // Informatsionnye Tekhnologii i Vychslitel'nye Sistemy // Archive

Informatsionnye Tekhnologii i Vychslitel'nye Sistemy, 2019 Issue 4, Pages 43–59 (Mi itvs362)

Improving the efficiency of Clusterix-like dbms for big data analytical processing

R. K. Klassen, V. A. Raikhlin

Kazan National Research Technical University named after A. N. Tupolev – KAI, Kazan. Russia

Abstract: Commercial OLAP-systems are economically unavailable for organizations with limited financial capabilities. Analytical processing large amounts of data in these organizations can be accomplished using open source software systems on a cost-effective cluster platform. Previously created Clusterix-like DBMS were not efficient enough according to the «performance/cost» criterion. With a view to the enhance the effectiveness of such systems in the article considers their further development with a focus on a full load of processor cores and the using GPU acceleration (systems Clusterix-N, N – from New) up to the development of a system comparable in efficiency to the open source system Spark, which is currently considered the most promising. The development methodology was based on the constructive system modeling methodology.

Keywords: analytic processing of significant data volumes, open source software systems on a cluster platform, increasing the efficiency of Clusterix-like DBMS, full loading of processor cores, full load of processor cores, GPU acceleration, comparison with Spark, accepted methodology.

DOI: 10.14357/20718632190405



© Steklov Math. Inst. of RAS, 2024