Agent evaluation based on multi-source heterogeneous information table using TOPSIS

Abstract

In agent evaluation, a specific role-playing may need more than one capabilities or the task execution process can be divided into several stages. The diverse perspectives to assess candidate agents are denoted as attributes, which is more practical than treating experts as attributes in many other works. In the evaluation table, the attribute values may come from different sources and the data types may not be the same. Therefore, we consider evaluation issues in a Multi-Source Heterogeneous Information System (MSHIS). Considering that grading, voting and marking are three common evaluation scenarios, linguistic variable, Intuitionistic Fuzzy Value (IFV) and real number are utilized to describe the corresponding evaluation results. To evaluate agents in MSHIS, a TOPSIS-based evaluation method is adopted in this work. In the proposed method, the range is utilized to nondimensionalize the distance between agents in each attribute. Then, a weighted Euclidean distance metric is adopted to measure the comprehensive distance. The relative closeness to the ideal agents reflects the agent’s capability on the concerned task. Finally, the illustrative example and comparative experiments are presented to illustrate the effectiveness of our method.