CrazyEngineers Forum

Turn The Screws!

Open your eyes, look in front, look at the back, look at any angle and you will see something that is an engineer's creation.

Engineers have been making things possible that others could only imagine. It perfectly makes sense to have a common place for engineers from around the world where they can share ideas, innovate, & help each other. Engineers are eternal, with the younger at 62 & the youngest at 17, the CEan gang consists of working professionals, students, entrepreneurs, CEOs, professors, geeks & nerds.

Need we say more? Click Here To Join The Gang!
Navigation
Go Back   CrazyEngineers Forum > CE : Labs > CE - Labs
Reply

  1 links from elsewhere to this Post. Click to view. #1 (permalink)
Old 24th May 2008, 01:49 PM
Good Administrator
 
The_Big_K's Avatar
 
I'm a Crazy Electrical Engineer
Join Date: 26th November 2005
Location: Terra-Firma
Posts: 3,776
Send a message via Yahoo to The_Big_K
Cool How to control Human Spammers on CE?

CEans,

Spam is a universal problem. There have been lot of discussions & techniques around to fight the spam. Its easy to control the computer bots that spam, but what about human spammers?

CEan Ash & I spend lot of our time on CE banning the spammers and removing their posts. Recently, we noticed that we're getting spammed by human spammers from China. I guess, these spammers are 'hired' to spam on the forums.

The question is - is there any effective way of dealing with human spammers? What strategy should we adopt to control the spam?

Post whatever ideas you have. No idea is bad, after all !
The_Big_K is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Sponsored links
  #2 (permalink)
Old 27th May 2008, 08:12 AM
ash
Moderator
 
ash's Avatar
 
I'm a Crazy Communications Engineer
Join Date: 12th July 2007
Location: IIUM, Malaysia
Posts: 1,215
Default Re: How to control Human Spammers on CE?

Ah, I wonder how much they get paid *rubs chin*

Using post filters is a good method, I suppose. But nothing beats human moderation! Speaking of which, we could try having CE moderators from different time zones. This could provide the 24 hour spam patrol we need
__________________
Keep it simple. Keep it real.
| New to CE? Click here! | Join our CE Bot project! | Problems? Questions? PM or mail me at ash{at]crazyengineers{dot]com |
ash is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)
Old 27th May 2008, 10:16 AM
Good Administrator
 
The_Big_K's Avatar
 
I'm a Crazy Electrical Engineer
Join Date: 26th November 2005
Location: Terra-Firma
Posts: 3,776
Send a message via Yahoo to The_Big_K
Default Re: How to control Human Spammers on CE?

Quote:
Originally Posted by ash View Post
Ah, I wonder how much they get paid *rubs chin*

Using post filters is a good method, I suppose. But nothing beats human moderation! Speaking of which, we could try having CE moderators from different time zones. This could provide the 24 hour spam patrol we need
Well, not much. Most of them are from China and I'm sure they aren't well paid.

Having mods from different time zones is a good idea. Moreover, I was thinking if we could maintain a database of known spammers & their IPs. It would be nice to update the spammer database at one location and verify new registrations using the data from the central database.

One more idea would be to restrict new members from posting links until their post count crosses 20. But I guess it would annoy few genuine new members.
The_Big_K is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)
Old 27th May 2008, 03:51 PM
CE - Editor In Chief
 
mayurpathak's Avatar
 
I'm a Crazy Civil Engineer
Join Date: 3rd January 2006
Location: Mumbai
Posts: 491
Send a message via Yahoo to mayurpathak Send a message via Skype™ to mayurpathak
Default Re: How to control Human Spammers on CE?

Database of spammers might be a good idea. But how many of such spammers will you block?

Manual moderation is a good idea. But if there are interested programmers, we can get a virtual moderation tool designed. The way they use it in Wikipedia
__________________
Mayur Pathak, Chief Editor, Blog Me, Contact me,
mayurpathak is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)
Old 27th May 2008, 03:53 PM
CEan - Value Adder
 
kidakaka's Avatar
 
I'm a Crazy Computer Science Engineer
Join Date: 18th October 2006
Location: Mumbai, Hyderabad
Posts: 421
Send a message via AIM to kidakaka Send a message via MSN to kidakaka Send a message via Yahoo to kidakaka Send a message via Skype™ to kidakaka
Default Re: How to control Human Spammers on CE?

Kapcha? Can we have kapcha when repetitive content is posted?
__________________
Do not click here
kidakaka is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Sponsored links
  #6 (permalink)
Old 27th May 2008, 04:01 PM
CE - Editor In Chief
 
mayurpathak's Avatar
 
I'm a Crazy Civil Engineer
Join Date: 3rd January 2006
Location: Mumbai
Posts: 491
Send a message via Yahoo to mayurpathak Send a message via Skype™ to mayurpathak
Default Re: How to control Human Spammers on CE?

Well what is that?

I found some information and this is a link I have got from source forge

SourceForge.net: kapcha IT Operations Management Portal
__________________
Mayur Pathak, Chief Editor, Blog Me, Contact me,
mayurpathak is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)
Old 28th May 2008, 08:05 AM
ash
Moderator
 
ash's Avatar
 
I'm a Crazy Communications Engineer
Join Date: 12th July 2007
Location: IIUM, Malaysia
Posts: 1,215
Default Re: How to control Human Spammers on CE?

I think kidakaka meant "captcha" Its the image verification thing where you have to enter the set of letters you see on the screen. This sorta helps combat the robot spams, but doesnt do much to human spammers. At most, it'll annoy them

Regarding blocking IP's.. its a good idea as long as they are static IPs (likely if they are a dedicated spamming company ). If they are individual spammers using dynamic IPs, blocking them would also block others who will be given that same IP address from their ISP later. Theres collateral damage there!

Quote:
Manual moderation is a good idea. But if there are interested programmers, we can get a virtual moderation tool designed. The way they use it in Wikipedia
Oh, is it like how you can click on the [edit] link for an article?

I notice we have that "report post" button for each post. Other CEans can help report the spam, I suppose. Avoids us having to dig around for spam, haha.
__________________
Keep it simple. Keep it real.
| New to CE? Click here! | Join our CE Bot project! | Problems? Questions? PM or mail me at ash{at]crazyengineers{dot]com |
ash is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)
Old 28th May 2008, 09:05 AM
Good Administrator
 
The_Big_K's Avatar
 
I'm a Crazy Electrical Engineer
Join Date: 26th November 2005
Location: Terra-Firma
Posts: 3,776
Send a message via Yahoo to The_Big_K
Default Re: How to control Human Spammers on CE?

[Ash: I'm going to simplify the process of banning ] Just press one button & the user is gone! Its gonig to be evil but I guess that's okay.
The_Big_K is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9 (permalink)
Old 28th May 2008, 11:24 AM
CE - Editor In Chief
 
mayurpathak's Avatar
 
I'm a Crazy Civil Engineer
Join Date: 3rd January 2006
Location: Mumbai
Posts: 491
Send a message via Yahoo to mayurpathak Send a message via Skype™ to mayurpathak
Default Re: How to control Human Spammers on CE?

Well a virtual moderation is a tool that sits over your code that allows users to post their content. Simplest version does the following things-

1. It allows only the registered and authentic users to post. You can also limit users from posting in a particular thread or section. (Basic utility)

2. It prevents usage of phrases and contents that are banned by the admins. Of course the phrase rules will have to be manually written. Mistakes repeated for specified number of times bans the user automatically from posting in a particular section or website on a whole.

3. You can also manually feed words which are objectionable. Posts with such words are not immediately posted but sent to the moderator for approval, via email alerts. Words are banned, but may be essential for the particular context. The moderator needs to take a decision.

4. Now for spamming, if you use a sentence where words don't make any sense in English language, the post is again sent to the moderator. This prevents people from using local languages and mobile jargons. This will save a lot of effort from Biggie to rebuff the newbies

5. All the posts with an html link are also sent for moderation. This prevents website from virus attacks as well.

This is a very simple utility. If you own a google group you will know.
__________________
Mayur Pathak, Chief Editor, Blog Me, Contact me,
mayurpathak is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #10 (permalink)
Old 28th May 2008, 09:52 PM
CE - Maniac
 
I'm a Crazy mechanical Engineer
Join Date: 5th March 2008
Location: Va
Posts: 532
Default Re: How to control Human Spammers on CE?

Good idea! Many other forums I am on use these & keep spam down. increasing moderators to deal with site/individua forum traffic also helps. Big K, I like your instant zap button idea.

Quote:
Originally Posted by mayurpathak View Post
Well a virtual moderation is a tool that sits over your code that allows users to post their content. Simplest version does the following things-

1. It allows only the registered and authentic users to post. You can also limit users from posting in a particular thread or section. (Basic utility)

2. It prevents usage of phrases and contents that are banned by the admins. Of course the phrase rules will have to be manually written. Mistakes repeated for specified number of times bans the user automatically from posting in a particular section or website on a whole.

3. You can also manually feed words which are objectionable. Posts with such words are not immediately posted but sent to the moderator for approval, via email alerts. Words are banned, but may be essential for the particular context. The moderator needs to take a decision.

4. Now for spamming, if you use a sentence where words don't make any sense in English language, the post is again sent to the moderator. This prevents people from using local languages and mobile jargons. This will save a lot of effort from Biggie to rebuff the newbies

5. All the posts with an html link are also sent for moderation. This prevents website from virus attacks as well.

This is a very simple utility. If you own a google group you will know.
__________________
"Now Nortons and Indians and Greeves won't do,
Ah, they don't have a soul like a Vincent '52"- Richard Thompson
"if you look for the bad in mankind, expecting to find it, you surely will."-Abraham Lincoln
gohm is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Sponsored links
  #11 (permalink)
Old 29th May 2008, 05:53 PM
CE - Editor In Chief
 
mayurpathak's Avatar
 
I'm a Crazy Civil Engineer
Join Date: 3rd January 2006
Location: Mumbai
Posts: 491
Send a message via Yahoo to mayurpathak Send a message via Skype™ to mayurpathak
Default Re: How to control Human Spammers on CE?

Thanks for the appreciation gohm. Are we capable and equipped to develop such a tool? Don't worry about writing business use cases and business rules. We have enough people here.

Biggie just an idea, can we take this up as an upcoming project under CE labs?
__________________
Mayur Pathak, Chief Editor, Blog Me, Contact me,
mayurpathak is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #12 (permalink)
Old 29th May 2008, 06:36 PM
Good Administrator
 
The_Big_K's Avatar
 
I'm a Crazy Electrical Engineer
Join Date: 26th November 2005
Location: Terra-Firma
Posts: 3,776
Send a message via Yahoo to The_Big_K
Thumbs up Re: How to control Human Spammers on CE?

Quote:
Originally Posted by mayurpathak View Post
Biggie just an idea, can we take this up as an upcoming project under CE labs?
Well, we'd love to have all such projects coming up. However, I still think we should start one 'SMALL' project & make it happen. CE Bot is in progress and xHx & Ash are doing fantastic job with it. The problem we still have is to get more number of active members.

Right now, to have such a functionality is not a big deal. We'll try to have it as a part of our next forum upgrade [though I'm not sure of it].

We'll try to have more number of moderators separated by time zones. That should help us moderate the forums round the clock. The 'ban' button should be there in couple of days.
The_Big_K is online now  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #13 (permalink)
Old 29th May 2008, 10:20 PM
CE - Maniac
 
I'm a Crazy mechanical Engineer
Join Date: 5th March 2008
Location: Va
Posts: 532
Default Re: How to control Human Spammers on CE?

Doesn't vbulletin offer some of the features Mayurpathak is referring too as part of their forum system tools?
__________________
"Now Nortons and Indians and Greeves won't do,
Ah, they don't have a soul like a Vincent '52"- Richard Thompson
"if you look for the bad in mankind, expecting to find it, you surely will."-Abraham Lincoln
gohm is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #14 (permalink)
Old 30th May 2008, 09:33 AM
Good Administrator
 
The_Big_K's Avatar
 
I'm a Crazy Electrical Engineer
Join Date: 26th November 2005
Location: Terra-Firma
Posts: 3,776
Send a message via Yahoo to The_Big_K
Default Re: How to control Human Spammers on CE?

Yep, they do. That's the reason we'll have to wait for the next forum upgrade.