Search engine spiders are the robots that visit the websites that are indexed ( mainly from a internet directory ) and collects information aboutits pages like keywords etc . This is because manually doing a round of the billion websites is not possible . Search Engines use spiders to index websites. When you submit your website pages to a search engine by completing their required submission page, the search engine spider will index your entire site. A ‘spider’ is an automated program that is run by the search engine system.Spider visits a web site, read the content on the actual site, the site's Meta tags and also follow the links that the site connects.
|