TITLE

Web Crawling

AUTHOR(S)
Olston, Christopher; Najork, Marc
PUB. DATE
April 2010
SOURCE
Foundations & Trends in Information Retrieval;2010, Vol. 4 Issue 3, p175
SOURCE TYPE
Academic Journal
DOC. TYPE
Article
ABSTRACT
This is a survey of the science and practice of web crawling. While at first glance web crawling may appear to be merely an application of breadth-first-search, the truth is that there are many challenges ranging from systems concerns such as managing very large data structures to theoretical questions such as how often to revisit evolving content sources. This survey outlines the fundamental challenges and describes the state-of-the-art models and solutions. It also highlights avenues for future work.
ACCESSION #
48298423

 

Share

Read the Article

Courtesy of THE LIBRARY OF VIRGINIA

Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics