jaysh4922
Level 1
Write the reason you're deleting this FAQ
A spider is also known as crawler or bot, this travels from one page to another page and visits the complete page.It represents the page that needs to be searched on the web site and displayed on the search engines.
Are you sure you want to delete this post?
patco444
Yes.. Well, I don't know how it works, but the main idea is to visit every website often (when the content is changed!) and to index it.
Are you sure you want to delete this post?