Seocheckout

Clear
Sign In Join

How would you prevent this?

  • angie828 Level X3
    • 4

    Write the reason you're deleting this FAQ

    How would you prevent this?

    Is there a way to prevent a spider from attaching itself to a URL that you do not want on the search engines?

    #spiders #search #engines Webmaster Related
    Share post:

    Comments

    Please login or sign up to leave a comment

    Join
    robertman11

    robertman11

    Use your robots.txt file or use .htaccess to actually blog the spider (you can block by IP or by user-client).
    13 years ago

    Are you sure you want to delete this post?

    Light

    Light

    Thanks for the information guys. How would you prevent this?
    13 years ago

    Are you sure you want to delete this post?