 |
|
|
Mod Options |
Ban Spiders by User Agent Details »
|
|||||||||||
|
Ban Spiders by User Agent
Developer Last Online: May 2020 
What this mod does
With this mod you can enter User Agents to watch or ban, you can also recieve emails or have an Output.txt created and updated with time and date of visits. It doesn't just have to be spiders, you can watch, log or ban any useragent! How to install Simply import the product ban_spider, the mod is active by default but none of the other options are turned on. What is a UserAgent? http://en.wikipedia.org/wiki/User_agent Understanding a UserAgent string http://user-agent-string.info/parse Genuine User Getting Blocked? http://www.vbulletin.org/forum/showp...&postcount=105 Tools to help http://whatsmyuseragent.com/SwitchingUserAgents.asp http://www.botsvsbrowsers.com/SimulateUserAgent.asp FAQ http://www.vbulletin.org/forum/showp...&postcount=137 How does it work? http://www.vbulletin.org/forum/showp...&postcount=381 What's a bot? http://en.wikipedia.org/wiki/Spambot How do i ban a bot? http://www.vbulletin.org/forum/showp...&postcount=318 http://www.vbulletin.org/forum/showp...7&postcount=51 Where's output.txt located? http://www.vbulletin.org/forum/showp...&postcount=216 Bad bot lists http://www.vbulletin.org/forum/showp...&postcount=259 http://www.vbulletin.org/forum/showp...&postcount=224 http://www.vbulletin.org/forum/showp...&postcount=281 Tested on vb3.7.x, vB3.8.x , vB4.x.x but should work on any version. ____________________________________________________________________ Special thanks to: Lior KH99 BoP5 for helping me sort out a few issues ...and beta testers ForceHSS (Special thanks to Force for latest testing) ozzy47 GreyHost If you use this please mark as INSTALLED History 9th June 2011 Orginal xml added 12th June 2011 Added both email notification and text file logging 22nd June 2011 Version 2.0.0, Added create thread on activity
08th October Beta testing started for thread creation. 20th October Beta testing started for emailing. 21st October Beta testing complete Ver 3.0.0 uploaded 29th October minor fix added to cope with empty userid on thread creation 30th October Beta testing automatic redirection to spiders/bots IP 31st October New xml uploaded with automatic redirect to IP 25th November Minor fix for blank forumid fixed 26th November 2011 Fixed version check & create thread Off by default 17th December 2014 Version 3.1.0 uploaded, Hook changed extra logging and statistics added by Ozzy47 (Chris) 18th December 2014 Version 3.1.1 uploaded, prevented spiders being counted when mod turned off. 17th December 2014 Version 3.1.2 uploaded, due to rogue code from another mod The Bad Bots list is now included in the product  Please prune out all those that you wish to be able to see your site (i suggest you definately prune out "DA" and "Custo" : Support will now only be given to those who have this mod marked as INSTALLED Download Now Only licensed members can download files, Click Here for more information. Supporters / CoAuthors Show Your Support
The following members like this post: puertoblack2003, Gn_Snake, htscpl, tanzeelniazi, too_cool_3 and 11 others.
|
|||||||||||
About Developer
Visit Web Site
Not Supported 
Uses Plugins|
Similar Mod
|
||||
| Mod | Developer | Type | Replies | Last Post |
| Miscellaneous Hacks Ban Spiders by User Agent | Simon Lloyd | vBulletin 3.8 Add-ons | 188 | 20 Jul 2015 12:34 |
|
#541
31 Dec 2013, 11:40
|
||||
|
||||
|
That would be a issue with your server, not the mod if I am not mistaken.
__________________
You can get access to my 180 mods for vB 3.6 - 4.x at The Admin Zone as well as the professional support you are used to. New vBulletin Spider Definitions, vBulletin Spiders List Hits 1000 Spiders! OzzModz down. Site has had a data breach, checking how the intrusion happened. Change your PW if you use the same one on my site and others. No members have liked this post.
|
|
#542
31 Dec 2013, 11:57
|
|||
|
|||
|
One question, regarding logging to a file. Shall the file be created by me, or is it created automagically by the mod? If I have to create it, what permissions are required?
__________________
John SV1CEC No members have liked this post.
|
|
#543
31 Dec 2013, 12:15
|
||||
|
||||
|
The mod should not mess with your install, if there was a problem it would be from the off and not give issues later. With regards logging, the mod creates the file provided that you have permissions on your server to create the same.
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#544
31 Dec 2013, 12:18
|
||||
|
||||
|
With regards emails it will depend on forum usage and and your daily allowances if you're not on a dedicated box.
Please attach a txt file of the contents of your ban list an a pic of your settings, the issues you described are not or have not been reported and seem unlikely to have been caused by the mod but we'll try and help as much as possible.
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#545
05 Jan 2014, 02:16
|
|||
|
|||
|
I'm running it on 4.2.2 just fine.
__________________
Bryan vB 4.2.5 No members have liked this post.
|
|
#546
14 Jan 2014, 19:45
|
|||
|
|||
|
What is Redirect URL: which url can i add ? explain please
Redirect to spiders own ip? can i tick Yes ? Spider List : Default Use Question: Baidu (Bing.com) Yandex: yahoo.com Its mean All traffic from Bing and yahoo Banned? No members have liked this post.
|
|
#547
14 Jan 2014, 20:25
|
||||
|
||||
|
Originally Posted by tanzeelniazi
Redirect URL is the url spiders will be directed to if they are in your "Spider List". If you select "Yes" to redirect to the spider's own IP this will override any url you set beneath it. You use one or the other.
No, all spider traffic from Bing and Yahoo will not be banned they are different services and have different spiders. Yes, there is some overlap in technologies used by some search engines but this will not affect you being scanned and ranked by Bing and Yahoo. I'm not sure why you made a direct correlation between Baidu (Chinese search engine) and Bing, then Yandex (Russian search engine) and Yahoo but they are all completely different services wholly owned by different companies ...for now. The following members like this post: Simon Lloyd
|
|
#548
14 Jan 2014, 21:36
|
||||
|
||||
|
What he ^^ said :-)
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#549
14 Jan 2014, 23:24
|
||||
|
||||
|
Originally Posted by tanzeelniazi
No it does not. It means anything with USER AGENT STRING including Bing and Yahoo are blocked. Don't confuse this with hostnames or referrers - those aren't affected by this.
No members have liked this post.
|
|
#550
15 Jan 2014, 00:13
|
||||
|
||||
|
Just to be clear again BING is NOT Baidu and Yahoo is NOT Yandex, this mod will only ban a spider/bot/person if their useragent contains an entry that you have in your list.
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! The following members like this post: Max Taxable
|
|
#551
19 Mar 2014, 22:19
|
|||
|
|||
|
Does this have an option to just block registrations?
No members have liked this post.
|
|
#552
19 Mar 2014, 23:24
|
||||
|
||||
|
No, blocking the bot, in affect stops them from your site all together, which is what you want to do with bad bots.
__________________
You can get access to my 180 mods for vB 3.6 - 4.x at The Admin Zone as well as the professional support you are used to. New vBulletin Spider Definitions, vBulletin Spiders List Hits 1000 Spiders! OzzModz down. Site has had a data breach, checking how the intrusion happened. Change your PW if you use the same one on my site and others. The following members like this post: Simon Lloyd
|
|
#553
20 Mar 2014, 06:29
|
||||
|
||||
|
When you've blocked a useragent they offender cannot even load a page on your site, so they cannot register or do anything.
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
#554
20 Mar 2014, 20:48
|
|||
|
|||
|
I used to see upwards of about 100-200 bots/guests on my board at all times of the day. I installed Simon's MOD last week and it has practically eliminated all the bad bots from seeing my website! I only see legit bots/guests viewing my website now!
Very happy with this MOD! The following members like this post: ozzy47, CAG CheechDogg
|
|
#555
20 Mar 2014, 21:15
|
||||
|
||||
|
Nice to hear its doing its job as well ad expected :-)
__________________
Kind regards, Simon Microsoft Office Help My Mods: Find my modifications here Please do not pm me for support unless i have invited you to! No members have liked this post.
|
|
«
Previous Mod
|
Next Mod
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Mod Options | |
|
|
| New To Site? | Need Help? |
All times are GMT. The time now is 03:22.
Powered by vBulletin® Version 3.8.14
Copyright © 2021, MH Sub I, LLC dba vBulletin. All Rights Reserved. vBulletin® is a registered trademark of MH Sub I, LLC
Copyright © 2021, MH Sub I, LLC dba vBulletin. All Rights Reserved. vBulletin® is a registered trademark of MH Sub I, LLC
Design by Princeton
Copyright ©2001 - , vbulletin.org. All rights reserved.
vBulletin® is a registered trademark. 