Program-oriented indicators: Production and application in science

The results of the project, whose goal is to create a tool for developing sets of indicators for monitoring and evaluating research and developments (R&D) program activities are presented. Each set of developed science and technology (S&T) indicators is oriented at the assessment of only one R&D program, i. e., at its objectives, resources, and results. The tool for developing indicators is being designed as an experts knowledge base named the proactive dictionary, which is the component of the evaluation system. This component enables experts to fix stages of indicators development, to present the results of developing different variants of indicators in graphic form, to compare and evaluate those variants, which are oriented at objectives, resources, and results of R&D program activities. The paper describes two theoretical models of the process of indicators development. It also describes a prototype of the proactive dictionary created on the base of these models. Finally, it describes the results of an experiment of development of a set of indicators by a group of the experts.