General Intelligent Dataset Description Method and Application

Abstract

With the development of the Internet, the growth rate of big data has exceeded the ability of human beings to obtain information from data. In the near future, faced with the sea of data, seemingly logically correct algorithms may come to the opposite conclusion, which will be a “data disaster” era. Therefore, letting data “speak” and enable data intelligence is an important problem that must be solved in the field of big data research. In this paper, we propose a “data intelligence” framework based on Brooks’s Subsumption Architecture for robotics. In this framework, we define a new dataset description method and try to encapsulate the dataset described by this method into a software container. Then, we set up the corresponding operations on the dataset container. Finally, we identify an interaction model for a “dataset agent” based on academic work on agents in the field of artificial intelligence. And we designed and implemented some functions of an intelligent document manager, which proves that our design ideas and methods are feasible.