Web Data Extraction and Integration System for Search Engine Results

Abstract

There is an explosive growth of information in the World Wide Web thus posing a challenge to Web users to extract essential knowledge from the Web. Search engines help us to narrow down the search in the form of Search Engine Result Pages (SERP). Web Content Mining is one of the techniques that help users to extract useful information from these SERPs. In this chapter, we propose two similarity-based mechanisms; Web Data Extraction using Similarity Function (WDES), to extract desired SERPs and store them in the local depository for offline browsing and Web Data Integration using Cosine Similarity (WDICS), to integrate the requested contents and enable the user to perform the intended analysis and extract the desired information. Our experimental results show that WDES and WDICS outperform Data Extraction based Partial Tree Alignment (DEPTA) [1] in terms of Precision and Recall.