cancel
Showing results for 
Search instead for 
Did you mean: 

how do I block ***ALL*** spiders/bots/non-human users?

orthohin
Grand Master

I had it set up previously and somewhere along the lines a server update has deleted my old .htaccess file that blocked all index spiders and everything, I've tried searching on google for how to do this to no avail, it seems I can find "how to block bad spiders" but, I don't care what they are, I want them all blocked.....

any assistance would be appreciated....

 

 

_________

 

 

Orthohin
1 REPLY 1

DaveA
BT Partner
BT Partner

Hi,

 

Managed to find this, which seems to indicate that it works:

 

http://www.webmasterworld.com/robots_txt/3769121.htm

 

Let us know how you get on.

 

Dave