Search Engine Glossary / Spider
Sometimes called Search Engine spiders, bots, robots and crawlers. These are programs developed and programmed to scour the web automatically for various reasons most notably they are used to index web pages, for spam detection, and the like. They are also known as web robots, web crawlers, bots, internet bots.
© seoWorks 2004-2016