Crawler

An automatic function of some search engines that index a page, and then visit subsequent pages that the initial page links to. As the cycle continues over time, search engine crawlers or “bots”/ “spiders” can index a massive number of pages very quickly.

« Back to Glossary Index
[gravityform id="3" title="false" description="false" ajax="true"]
[gravityform id="3" title="false" description="false"]