RUS  ENG
Full version
JOURNALS // Upravlenie Bol'shimi Sistemami // Archive

UBS, 2021 Issue 89, Pages 45–72 (Mi ubs1068)

Control in Social and Economic Systems

Experimental studies on the test questions based on the point ratio

N. Kalmykova, Yu. V. Sidel'nikovab

a V.A. Trapeznikov Institute of Control Sciences of RAS, Moscow
b Moscow Aviation Institute (National Research University)

Abstract: The article proposes the existence of an objective component of the complexity of the problem which is experimentally verified and proposes the point ratio which is introduced and experimentally studied. For this purpose, the so-called "point coefficient" is introduced and experimentally investigated, which allows us to estimate the level of complexity of the problem given in the form of a test questions. This coefficient is based on the answers to these questions that the level of complexity of the problem is estimated. Hypotheses describing the dynamics of changes in the values of the point coefficient are proposed and experimentally tested. Also, the stability of the obtained conclusions based on the results of calculations for two qualitatively different coefficients relative to the number of respondents was checked. The criterion for determining the test question as a problem of the third level of complexity is experimentally found and tested. The reason for this is the nature of the change in the range of the spread of the values of the histogram coefficient. An experimental study of the presence of cognitive distortions in the assessment of some test tasks by experts was conducted. Possible directions for further development are proposed.

Keywords: expert appraisals, test question, point ratio.

UDC: 303.833.5+303.832.32
BBK: 65.054. 3+ 16.23+ 87.256.643

Received: August 31, 2020
Published: January 31, 2021

DOI: 10.25728/ubs.2021.89.2



© Steklov Math. Inst. of RAS, 2024