Abstract
The paper aims to present a new methodology to evaluate the quality of features and functionality of learning object repositories (LORs). The quality of features and functionality of LORs is analysed in terms of engaging LOR users and content producers. Thus, it can be referred to as quality-in-use of LORs. This methodology consists of creation and consequent application of methods and the model for the quality-in-use of LORs. The model of the quality-in-use of LORs is presented in this paper. The methodology for evaluating the quality-in-use of LORs is based on the general MCEQLS (Multiple Criteria Evaluation of the Quality of Learning Software) approach to evaluate the quality of learning software. The essential part of the novel methodology is the application of improved Fuzzy AHP method to establish criteria weights of the quality-in-use of LORs. It is shown that the created methodology is suitable and stable for evaluating the quality of LOR features and its functionality. A more detail presentation is given on the results of the expert evaluation of the quality-in-use of three LORs that are most popular in Lithuania against the proposed methodology. The novelty of the presented research is achieved through the innovative instrument consisting of the model of the quality-in-use of LORs and the Fuzzy AHP method. The presented methodology could serve as a technological tool for decision making in education as well as in different areas of economy.
Highlights
Learning object repositories (LORs), or learning repositories, are referred to here as properly constituted systems, i.e. organised collections of learning objects (LOs) consisting of learning objects, their metadata and tools/services to manage them (Kurilovas 2013)
According to the general MCEQLS approach, in order to practically evaluate the quality-in-use of alternative learning repositories, the experts-evaluators should use several steps: (1) use the LOR quality model constructed with the help of principles of the multiple criteria decision analysis for the identification of quality criteria; (2) establish the weights of LOR quality-in-use criteria according to the normalisation requirement and the Fuzzy Analytic Hierarchy Process (AHP) method can be used for this purpose; (3) evaluate the alternatives against all the quality criteria; (4) calculate the numerical value of the quality-in-use of a particular LOR alternative using the obtained numerical values and the weights of the quality criteria with the help of the experts’ additive utility function (Kurilovas et al 2011)
The higher is the numerical value of the quality of the particular LOR alternative, the higher is the quality of this alternative in comparison with other evaluated alternatives, and the educational institutions should decide on the purchase or creation of this LOR alternative for their educational needs
Summary
Learning object repositories (LORs), or learning repositories, are referred to here as properly constituted systems, i.e. organised collections of learning objects (LOs) consisting of learning objects, their metadata and tools/services to manage them (Kurilovas 2013). Educational institutions are interested in using high-quality LOR software. The problem related to the evaluation of the quality of LORs is high on the agenda of the international research and education systems. According to Gasperovic and Calpinskas (2006), the “internal quality” is a descriptive characteristic that defines the quality of software independently from any particular context of its use, while the “quality-in-use” is an evaluative characteristic of software obtained by making a judgment based on the criteria that determine the worthiness of software for particular users.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
