Abstract
The vast collections of web pages are available on the Internet. Web search engine strives to gather information as more relevant as possible to the user is a hard task. Nowadays maintaining high efficiency is a difficult issue because of the large amount of information available on the web as well as deep web has dynamic nature. As crawler plays important role in such cases. Here we surveyed how the smart crawler can provide accuracy and highest harvest rate than other crawlers due to its two-stage framework. The first stage is site locating, the search engine can search highly ranking pages to avoid visit of a large number of pages. The second stage is a site exploring; it uses a link tree to balance link prioritizing of relevant links for fast searching. Keywords: Crawler, URLs, FFC, ACHE, Deep Web.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: International Journal of Advanced Research in Computer Science
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
