A search engine spider, crawler, or bot is a program that automatically fetches or feeds pages to the search engine that sent it for indexing.

Spiders, Crawlers, and Bots

Spiders, bots, and crawlers can also be sent by anyone trying to steal information, such as email addresses, off of your website. Beware of these stealth email spammers!