web crawler
Definition
Search engine for locating information on WWW, it indexes all the words in a document, adds them to a database, then follows all hyperlinks and indexes and adds that information also to the database. Also called web spider.
Search engine for locating information on WWW, it indexes all the words in a document, adds them to a database, then follows all hyperlinks and indexes and adds that information also to the database. Also called web spider.