RUS  ENG
Full version
JOURNALS // Vestnik Yuzhno-Ural'skogo Gosudarstvennogo Universiteta. Seriya "Vychislitelnaya Matematika i Informatika" // Archive

Vestn. YuUrGU. Ser. Vych. Matem. Inform., 2014 Volume 3, Issue 1, Pages 113–120 (Mi vyurv33)

Brief Reports

A method for distributed concept drift detection

A. A. Volkova, L. Büchb, A. Andrzejakb

a South Ural State University (Chelyabinsk, Russian Federation)
b Heidelberg University (Heidelberg, Germany)

Abstract: The paper introduces a method for distributed concept drift detection for data mining algorithms. Concept drift is understood as any unpredictable alteration in input data. There is an algorithm implementation proposed, based on MapReduce distributed computing technology. Proposed algorithm meant for concept drift detection in streaming data in online fashion. In order to provide iterative Map and Reduce phases a MapReduce framework is introduced. The algorithm is able to automatically detect input data alteration, which demands model parameters change and switching a new model online.

Keywords: concept drift, data mining, distributed computations, iterative MapRedice.

UDC: 004.042

Received: 02.10.2013



© Steklov Math. Inst. of RAS, 2024