The Model and Optimization of Search Engine Based on Hadoop

Abstract

With the rapid increase of websites and internet users, the traditional search engine will face great challenge in the real-time search, response speed and mass storage pages. As cloud computing with two major advantages in massive data processing and mass data storage, so the search engine deployed in the cloud can solve these shortcomings. By analyzing the open-source cloud computing system Hadoop, cloud platform search engine model is constructed and search engine algorithm is optimized to improve the overall performance of search engines.