Register Members List Search Today's Posts Mark Forums Read

Reply
 
Mod Options
Keyword weight based spam detector Details »
Keyword weight based spam detector
Mod Version: 0.1.0, by HuangA (Member) HuangA is offline
Developer Last Online: Jun 2013 I like it Show Printable Version Email this Page

This modification is in the archives.
vB Version: 3.7.0 Beta 5 Rating: (8 votes - 4.88 average) Installs: 38
Released: 08 Jul 2008 Last Update: 09 Jul 2008 Downloads: 199
Not Supported Uses Plugins Translations Is in Beta Stage  

I coded this one because I constantly had to moderate and / delete them lengthy lame cell phone ads on vBulletin.com's forums and my own forums. You know, buy iphone, ipod touch, noika blah blah blah sony ericsson blah blah blah etc. etc. etc. email us, we're legitimate business in a country you've never heard of, blah blah blah spam.

While Akismet does work on filtering them out, some times they still leak through.

I know there's two other keyword based tools that automatically adds things to moderation queue (One from SirAdrian and one from tweakmonkey), but it doesn't work too well for me, because I run an iPhone / iPod Touch site and I can't have those keywords on auto spam for simply appearing. So, here's what I did for mine...

What does this product do?
  • Adds 1 vBulletin Options setting group, with 4 settings
  • Allows you to define a list of keywords with associated score
  • Allows you to set a threshold for automatic moderation
  • Allows you to set a threshold for automatic rejection
  • Allows you to set a post count limit for posts to be scanned
  • Adds 1 plugin which gets ran at newpost_process
  • Adds 1 plugin which gets ran at editpost_update_process

How does it work?
1) You configure your keyword list, and score weight. For example, I use this list:

Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.

The list basically means each time the plugin sees "Noika", it will get a score of 0.5, $, 0.5, etc. etc. A tally of all the score is totaled, and
2) You configure your moderation score, for example, I use 50.
3) You configure your rejection score, for example, I use 100.
4) You configure your exemption post count, for example, I use 5.

When a new post is being created (this could be a thread, or a reply, doesn't matter, they both trigger newpost_process hook), the plugin will count how many times each keyword appears, and total the score. If it is higher than or equal to the moderation score, it will tuck the post into moderation queue. If it is higher than or equal to the rejection score, a standard vBulletin error message is shown to the user.

How much overhead does this add? Realistically, not much... depending on amount of keywords used, I'd say most likely under 0.05 seconds of your CPU time for each post. If you are really that worried, you can set your exemption post count to something lower, and so lesser posts are scanned. Default is 5 right now.

This have been tested on 3.7.0 Beta 5, and 3.7.2. I see no reason why it would not work on 3.6.x series, too.

Change log
0.0.0 => 0.1.0
  • Changed error message to use vBulletin error message screen instead of die()
  • Added option for omitting after certain post count (default 5)
  • Added default values to options
  • Fixed options not appearing after product import (I forgot to export them for 0.0.0)
  • Added scanning for editing post (AJAX doesn't seem to give error... I'll work on that for 0.1.1 later)

Download Now

Only licensed members can download files, Click Here for more information.

Show Your Support

  • To receive notifications regarding updates -> Click to Mark as Installed.
  • If you like this modification support the author by donating.
  • This modification may not be copied, reproduced or published elsewhere without author's permission.
Similar Mod
Mod Developer Type Replies Last Post
Administrative and Maintenance Tools Multiple account login detector (AE Detector) MPDev vBulletin 3.6 Add-ons 598 25 Nov 2013 03:28

  #16  
Old 18 Dec 2008, 05:15
Chadi's Avatar
Chadi Chadi is offline
 
Join Date: May 2004
This is not working for me at all in 3.7.4

Nokia|1.0
iPhone|1.0
iPod Touch|1.0
Order|1.0
HTC|1.0
Samsung|1.0
Sony Ericsson|1.0
hotmail|1.0
$|1.0
usd|1.0
url|0.3
email|1.0
Created a regular member called test (zero post count) and attmpted to post based on the keywords. I posted Nokia about 10 times, post went through fine.

Moderate Threshold Score is set to 5
Reject Threshold Score is set to 0
Spam Scanning Post Threshold is set to 5
__________________
...............................
Talk Jesus Forums: Christian Chat
games . chat . gallery . bible . videos
Reply With Quote
  #17  
Old 18 Dec 2008, 08:27
veenuisthebest's Avatar
veenuisthebest veenuisthebest is offline
 
Join Date: Mar 2008
Real name: Vinayak
Not sure why it is not working for you. Works more than great for me on 3.7.4.

Try setting "Moderate Threshold Score is set to 50" as 5 is tooo less. And try posting a real spam post, search for it.
Reply With Quote
  #18  
Old 25 Mar 2009, 20:41
tekguru tekguru is offline
 
Join Date: May 2007
Does this work okay on 3.8.1?
Reply With Quote
  #19  
Old 26 Mar 2009, 06:43
HuangA's Avatar
HuangA HuangA is offline
 
Join Date: Jun 2004
Real name: Andy Huang
The hooks for that haven't changed, I think you should be okay. Though, I don't honestly recall which version is the up most version number I've defined for this. If it tells you that your version is not compatabile, then you can try to edit the xml to get around the limitation, and then install it. In the worst case where it doesn't work, just uninstall it
Reply With Quote
  #20  
Old 15 May 2009, 16:58
Farstate Farstate is offline
 
Join Date: Mar 2004
Great mod - works fine on 3.8.1 PL1
Reply With Quote
  #21  
Old 08 Sep 2009, 23:22
TimberFloorAu's Avatar
TimberFloorAu TimberFloorAu is offline
 
Join Date: May 2008
Real name: Blue
Installed on 3.8.4

JUst so I can get my head round all this, if we set a weight of 1.0 for say the word viagra, and that is used 48 times within a new post of a member who has less than 5 posts, and our threshold score is say 50... then their post gets POSTED ?
__________________

My Hacks [ click ] | Steve ~ Administrator for British Expats AustraliaBound.org/forum | Test our forum - user; don pass; pass123
Sports Tipping Mod - coming February 2010 ~ Show your Interest !
Reply With Quote
  #22  
Old 09 Sep 2009, 08:00
HuangA's Avatar
HuangA HuangA is offline
 
Join Date: Jun 2004
Real name: Andy Huang
Assuming moderation threshold score set at 50, reject threshold set to 100 and it scans only people with < 5 posts...

User 1 with post count of 50:
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
Post appears.

User 2 with post count of 2:
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra
Post appears.

User 3 with post count of 4:
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
Post goes to moderation queue.

User 4 with post count of 1:
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
viagra viagra viagra viagra viagra viagra viagra viagra viagra viagra
Cialis. Prescription. ... oh, and watch replicas!
Post doesn't even get posted.


Of course, you should have more than one word, and they'd run into the limit a lot sooner. You can also have things like $, http://, url=, etc. on your list. You can also adjust the threshold limits. You can also adjust the keyword weight (IE: viagra = 50 points right away).

Long story short, you control the magic.

Nokia cell phones anyone?
Reply With Quote
  #23  
Old 09 Sep 2009, 09:32
TimberFloorAu's Avatar
TimberFloorAu TimberFloorAu is offline
 
Join Date: May 2008
Real name: Blue
Cheers Andy ! Good one.
__________________

My Hacks [ click ] | Steve ~ Administrator for British Expats AustraliaBound.org/forum | Test our forum - user; don pass; pass123
Sports Tipping Mod - coming February 2010 ~ Show your Interest !
Reply With Quote
  #24  
Old 15 Sep 2009, 12:17
HansiB HansiB is offline
 
Join Date: May 2003
Where do i put/find the keyword and threshold settings?
Reply With Quote
  #25  
Old 16 Sep 2009, 11:17
HuangA's Avatar
HuangA HuangA is offline
 
Join Date: Jun 2004
Real name: Andy Huang
You can enter your keywords and weights in Admin CP > vBulletin Options > Keyword Weight Anti-spam.
You will need to find and craft your own set of filter to cater the spams that you are getting though. The default set really only targets one set of commonly recurring ad for certain cell phone seller...
Reply With Quote
  #26  
Old 07 May 2010, 10:09
washingtonboise washingtonboise is offline
 
Join Date: Mar 2009
Very impressed with this mod, found that negative values also work.
e.g. if you have a forum about selling cialis and don't want people posting about viagra, you can give 'cialis' a negative value so that if someone happens to use both in the same post (maybe they're comparing the differences and that makes it NOW an on-topic post), chances are the system will allow the conversation unless they say viagra multiple times.
Reply With Quote
  #27  
Old 09 May 2010, 21:03
InsaneNutter InsaneNutter is offline
 
Join Date: Apr 2007
Works perfectly to stop bots spamming warez / trojans too.

For example hotfile.com is now worth 1 point on our forum, so when a bot spams links to warez hosted on hotfile.com the post is instantly rejected

Surprised this mod has not gained more attention, I can see this been a great asset to our forum!

Keep up the great work.
Reply With Quote
  #28  
Old 07 Jun 2010, 09:21
maxc0der maxc0der is offline
 
Join Date: Mar 2007
Impressive... Just wanted to say thanks.

It hasn't been updated for a while but I hope we can see a 4.0 version.
Reply With Quote
  #29  
Old 22 Jun 2010, 19:05
EtaiWix EtaiWix is offline
 
Join Date: Jun 2010
I'm so sorry for the noob question, but how do I install it?

I downloaded the XML file but I'm at a loss for what to do...

Thanks for the help!
Reply With Quote
  #30  
Old 22 Jun 2010, 19:52
EtaiWix EtaiWix is offline
 
Join Date: Jun 2010
Nevermind, I found it... THANKS!!!!

This is GREAT!!

Now if only someone who knows some coding can help me with my other problem...
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Mod Options

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


New To Site? Need Help?

All times are GMT. The time now is 00:47.

Layout Options | Width: Wide Color: