 |
|
|
Mod Options |
Ban Spiders by User Agent Details »
|
|||||||||||
|
Ban Spiders by User Agent
Developer Last Online: May 2020 
What this mod does
With this mod you can enter User Agents to watch or ban, you can also recieve emails or have an Output.txt created and updated with time and date of visits. It doesn't just have to be spiders, you can watch, log or ban any useragent! How to install Simply import the product ban_spider, the mod is active by default but none of the other options are turned on. What is a UserAgent? http://en.wikipedia.org/wiki/User_agent Understanding a UserAgent string http://user-agent-string.info/parse Genuine User Getting Blocked? http://www.vbulletin.org/forum/showp...&postcount=105 Tools to help http://whatsmyuseragent.com/SwitchingUserAgents.asp http://www.botsvsbrowsers.com/SimulateUserAgent.asp FAQ http://www.vbulletin.org/forum/showp...&postcount=137 How does it work? http://www.vbulletin.org/forum/showp...&postcount=381 What's a bot? http://en.wikipedia.org/wiki/Spambot How do i ban a bot? http://www.vbulletin.org/forum/showp...&postcount=318 http://www.vbulletin.org/forum/showp...7&postcount=51 Where's output.txt located? http://www.vbulletin.org/forum/showp...&postcount=216 Bad bot lists http://www.vbulletin.org/forum/showp...&postcount=259 http://www.vbulletin.org/forum/showp...&postcount=224 http://www.vbulletin.org/forum/showp...&postcount=281 Tested on vb3.7.x, vB3.8.x , vB4.x.x but should work on any version. ____________________________________________________________________ Special thanks to: Lior KH99 BoP5 for helping me sort out a few issues ...and beta testers ForceHSS (Special thanks to Force for latest testing) ozzy47 GreyHost If you use this please mark as INSTALLED History 9th June 2011 Orginal xml added 12th June 2011 Added both email notification and text file logging 22nd June 2011 Version 2.0.0, Added create thread on activity
08th October Beta testing started for thread creation. 20th October Beta testing started for emailing. 21st October Beta testing complete Ver 3.0.0 uploaded 29th October minor fix added to cope with empty userid on thread creation 30th October Beta testing automatic redirection to spiders/bots IP 31st October New xml uploaded with automatic redirect to IP 25th November Minor fix for blank forumid fixed 26th November 2011 Fixed version check & create thread Off by default 17th December 2014 Version 3.1.0 uploaded, Hook changed extra logging and statistics added by Ozzy47 (Chris) 18th December 2014 Version 3.1.1 uploaded, prevented spiders being counted when mod turned off. 17th December 2014 Version 3.1.2 uploaded, due to rogue code from another mod The Bad Bots list is now included in the product  Please prune out all those that you wish to be able to see your site (i suggest you definately prune out "DA" and "Custo" : Support will now only be given to those who have this mod marked as INSTALLED Download Now Only licensed members can download files, Click Here for more information. Supporters / CoAuthors Show Your Support
The following members like this post: puertoblack2003, Gn_Snake, htscpl, tanzeelniazi, too_cool_3 and 11 others.
|
|||||||||||
About Developer
Visit Web Site
Not Supported 
Uses Plugins|
Similar Mod
|
||||
| Mod | Developer | Type | Replies | Last Post |
| Miscellaneous Hacks Ban Spiders by User Agent | Simon Lloyd | vBulletin 3.8 Add-ons | 188 | 20 Jul 2015 12:34 |
|
#811
01 Nov 2016, 15:26
|
||||
|
||||
|
That isn't an issue with this modification as it doesn't use glowhostspamomatic. You also have a blank in your list, this could effectively ban everyone and everything!!
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#812
01 Nov 2016, 15:33
|
||||||||
|
||||||||
|
Originally Posted by grafbyte
Add this to your config under <?php:
__________________
 Let us take care of your forum, seo, seo reports, maintenance, what ever you need. No members have liked this post.
|
||||||||
|
#813
28 Dec 2016, 20:37
|
|||
|
|||
|
I have a dumb question. I'm up on running a forum and such, but not on SEO and what these spiders and bots are actually doing. Since installing this product, I continually notice that the blocked spiders number keeps going up...at an alarming rate. First it was a few hundred, then it was a thousand, and now its about 8100 blocked spiders at a given moment. That was about 3-4 weeks ago. What's going on? Is this something along the lines of, "block them and they will come?" I fear the day that this plug in gets disabled by accident or whatever because the floodgates might come bursting open.
No members have liked this post.
|
|
#814
03 Jan 2017, 19:53
|
||||
|
||||
|
Which bots are showing as increasing in numbers? it's more than likely the same bot that keeps changing IP address, don't worry it will settle down.
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#815
05 Jan 2017, 18:06
|
|||
|
|||
|
I just wanted to thank you for this. My site had slowed to a crawl with page load times of 15 seconds and I did not know why. I installed this and my page loads are now mostly under a second.
I had no idea these bots and spiders were doing this to me..after a week I see this. Spiders/Bots Activity Blocked From Site: 102,285 Thanks again, much appreciated. The following members like this post: Simon Lloyd, Delfi_r
|
|
#816
08 Jan 2017, 15:25
|
||||
|
||||
|
I suspect that you have some other process issues that are affecting load times but I'm glad this has helped.
Do take a look at your images that your site has, try to use a CDN to deliver them or maybe create a sprite to contain them all and deliver the images from sprite coordinates, also look at which scripts are called on page load, sometimes its best to try and minimize these and minify your JS scripts, this might help https://hostway.com/blog/10-ways-to-...e-load-faster/ Its a bit of work but well worth the effort.
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! The following members like this post: w00fy
|
|
#817
25 Apr 2017, 09:14
|
|||
|
|||
|
I also have been using this product for over year and initially it wiped 90% of the traffic, as they were bots but over time the number has gone back up again.
I would assume what we need is a new list of bots? Have had a search around but cant find one??? I am using this updated list as per a few posts back:
No members have liked this post.
|
|
#818
11 Oct 2017, 09:54
|
||||
|
||||
I just installed this on 4.2.5, and as soon as I have it installed, this is showing up on the left upper side of my header where the logo is.
Could anyone tell me if that can be fixed, and if, how ? Thanks in advance. Wolf No members have liked this post.
|
||||
|
#819
23 Aug 2019, 10:39
|
|||
|
|||
|
Seems to work fine for me on VBulletin 4.2.5 so the error above in @WOLF-G4MIN-X's post must be the Glowhost Spamomatic mod incompatibility mentioned elsewhere in the thread.
No members have liked this post.
|
|
#820
24 Aug 2019, 12:50
|
||||
|
||||
|
Originally Posted by WOLF-G4MIN-X
I havent seen this before and it doesn't use the bootstrap, This loads at every page call which prevents the spiders actually loading a page, so it could be a third party hack that doesn't like it being loaded, you could change the load order in the products page of admincp, normally most hacks are set at 5.
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
||||
|
#821
20 Jan 2020, 12:00
|
||||
|
||||
|
I installed latest version of hack but it not stops huawei crawler service I see multiple entries that are online for example
ecs-159-138-101-77.compute.hwclouds-dns.com ecs-159-138-109-55.compute.hwclouds-dns.com No members have liked this post.
|
|
#822
20 Jan 2020, 13:55
|
||||
|
||||
|
Just use this in your ban list,
compute.hwclouds-dns.com
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#823
21 Jan 2020, 13:10
|
||||
|
||||
|
Originally Posted by Simon Lloyd
I did, it's not blocked.Still showing in online list
Is the latest hack compatibile with 4.2.3pl1 version of the forum? No members have liked this post.
|
|
#824
21 Jan 2020, 14:20
|
||||
|
||||
|
When you say "online list" are you using another hack like Paul Ms Who's online....etc?
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#825
21 Jan 2020, 21:38
|
||||
|
||||
|
No, thats the only hack I'm using to ban spiders.
User agents appear under forum user online list , it can be up to 20 entries in the same time. Forum is behind cloudflare. No members have liked this post.
|
|
«
Previous Mod
|
Next Mod
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Mod Options | |
|
|
| New To Site? | Need Help? |
All times are GMT. The time now is 03:53.
Powered by vBulletin® Version 3.8.14
Copyright © 2021, MH Sub I, LLC dba vBulletin. All Rights Reserved. vBulletin® is a registered trademark of MH Sub I, LLC
Copyright © 2021, MH Sub I, LLC dba vBulletin. All Rights Reserved. vBulletin® is a registered trademark of MH Sub I, LLC
Design by Princeton
Copyright ©2001 - , vbulletin.org. All rights reserved.
vBulletin® is a registered trademark. 