Thread: Bots
View Single Post
  #5  
Old 18 Apr 2012, 12:48
Irishnotsane Irishnotsane is offline
 
Join Date: Apr 2012
Ah right, so by adding

User-agent: *
Disallow: /
In my robots.txt file in my ROOT directory, it'll disallow all bots (unless of course they choose to ignore it)

So by having this, plus that product, it should get rid of 90% (or so) of bots?
Reply With Quote