General Solution to the Requirement-Oriented Integration of Deep Web

Abstract

In the recent years, the Web has been rapidly “deepened” by the massive web databases on the Internet, which refers to Web”. All the existing methods to access the Deep Web are dataoriented, which don’t consider the various personalized needs of individuals and cannot effectively fill the huge gap between the users and the Deep Web. So the future trend of Deep Web integration must be the systems which are user-oriented and can provide the users with the experience of “fetch on demand”. This paper puts the focus on the topic of requirement-oriented integration of Deep Web and proposes a novel integrate solutions of Deep Web and does some exploratory research on the key issues of this solution. In this solution, the system is composed of three components: Requirement Analysis Engine (RAE), Plan Generation Engine (PGE) and Query Execution Engine (QEE). With the collaborative work of these three engines, the goal of “taking on-demand” and “one-stop” can be achieved. In addition, the open framework of this solution makes it easy to integrate the existing research efforts and techniques.