Citation

Seel NM, Schenk K. Eval. Program Plann. 2003; 26(2): 215-224.

Copyright

(Copyright © 2003, Elsevier Publishing)

DOI

10.1016/S0149-7189(03)00003-X

PMID

unavailable

Abstract

This article deals with the evaluation of a multimedia learning environment which has been developed and evaluated within the broader context of a research project on the learning-dependent progression of mental models in economics. To carry out formative evaluations, we have adapted a particular evaluation approach which allows and requires the implementation of specific evaluation instruments. The crucial questions of our evaluation studies were the efficacy of a multimedia-based realization of the cognitive apprenticeship (CA) approach, the diagnosis of mental model progression through the CA based instruction, and the effects of implemented metacognitive training. For the assessment of the learning-dependent progression of the mental models, we developed and used a special diagnostic instrument for causal diagrams, which are understood as reproductions of students' mental models. In order to be able to meet statements about the practicability of a multimedia based realization of CA, we measured the results of the tasks of learning during each different learning phase. Additionally, several motivational variables and persistent learning strategies were measured. In this article, we will specify the adapted evaluation instruments. Furthermore, we will report on the results of five replication studies and discuss the consequences for instructional design in connection with the design of constructive learning environments.