DYNAMICALLY ORGANIZING KDD PROCESSES

Abstract

How to increase both autonomy and versatility of a knowledge discovery system is a core problem and a crucial aspect of KDD (Knowledge Discovery and Data Mining). Within the framework of the KDD process and the GLS (Global Learning Scheme) system recently proposed by us, this paper describes a way of increasing both autonomy and versatility of a KDD system by dynamically organizing KDD processes. In our approach, the KDD process is modeled as an organized society of KDD agents with multiple levels. We propose an ontology to describe KDD agents, in the style of OOER (Object Oriented Entity Relationship) data model. Based on this ontology of KDD agents, we apply several AI planning techniques, which are implemented as a meta-agent, so that we might (1) solve the most difficult problem in a multiagent KDD system: how to automatically choose appropriate KDD techniques (KDD agents) to achieve a particular discovery goal in a particular application domain; (2) tackle the complexity of KDD process; and (3) support evolution of KDD data, knowledge and process. The GLS system, as a multistrategy and multiagent KDD system based on the methodology, increases both autonomy and versatility.