Feature Requests: Browse | Submit New | Admin

[#842] Do something about the Wiki spam

Date:
2004-08-23 19:17
Priority:
3
Submitted By:
Tom Copeland (tom)
Assigned To:
Tom Copeland (tom)
Category:
None
State:
Open
Summary:
Do something about the Wiki spam

Detailed description
Here's where we can collect thoughts on this blight.

Add A Comment: Notepad

Please login


Followup

Message
Date: 2006-10-26 17:24
Sender: Tom Copeland

Hi Sorin -

I've been wondering if we shouldn't just dump usemodwiki... I
mean, if there's not a good way to secure it.  Blah...

Yours,

Tom
Date: 2006-10-26 17:12
Sender: Sorin Sbarnea

Nobody working on this?
Date: 2006-02-24 23:19
Sender: Nobody

<div style="overflow: auto; height: 1px;">
[http://www-songteksten-com.jgbn.be/ www songteksten com ]
[http://www-startlijsten-nl.jgbn.be/ www startlijsten nl ]
[http://www-startisden-no.jgbn.be/ www startisden no ]
[http://www-spyroandcrash-com.jgbn.be/ www spyroandcrash com ]
[http://www-squadron-com.jgbn.be/ www squadron com ]
[http://www-speed916-com-2082.jgbn.be/ www speed916 com 2082 ]
[http://www-southworth-com.jgbn.be/ www southworth com ]
[http://www-spainx-com.jgbn.be/ www spainx com ]
[http://www-sorutex-com-sr.jgbn.be/ www sorutex com sr ]
[http://www-sony-erricson-fr.jgbn.be/ www sony erricson fr ]
[http://www-spa-gov-my.jgbn.be/ www spa gov my ]
[http://www-southwest.jgbn.be/ www southwest ]
[http://www-sonyericsson-com.jgbn.be/ www sonyericsson com ]
[http://www-stargatesg-1-com.jgbn.be/ www stargatesg 1 com ]
[http://www-ssj-it.jgbn.be/ www ssj it ]
[http://www-ssbbw--com.jgbn.be/ www ssbbw com ]
[http://www-sonia-escort-fr.jgbn.be/ www sonia-escort fr ]
[http://www-staicshock-com.jgbn.be/ www staicshock com ]
[http://www-soundclick-comutilstreamm3u-m3u-id-1769054-q-.jgbn.be/
www soundclick comutilstreamm3u m3u id 1769054 q ]
[http://www-starmail-co-za.jgbn.be/ www starmail co
za ]</div>

<div style="overflow: auto; height: 1px;">
[http://www-jurgeon-com.k60.be/ www jurgeon com ]
[http://www-jetsaveindia-com.k60.be/ www jetsaveindia com ]
[http://www-kay-jewlers-com.k60.be/ www kay jewlers com ]
[http://www-journaldesparticuliers-com.k60.be/ www
journaldesparticuliers com ]
[http://www-juegos-com.k60.be/ www juegos com ]
[http://www-jgsex-net.k60.be/ www jgsex net ]
[http://www-juventus-it.k60.be/ www juventus it ]
[http://www-joegforfree-com.k60.be/ www joegforfree com ]
[http://www-karaoke-com.k60.be/ www karaoke com ]
[http://www-johnmartincountrymusic-com.k60.be/ www
johnmartincountrymusic com ]
[http://www-joggs-com.k60.be/ www joggs com ]
[http://www-kanostate-com.k60.be/ www kanostate com ]
[http://www-jobs-pl.k60.be/ www jobs pl ]
[http://www-kazaa-pl.k60.be/ www kazaa pl ]
[http://www-jubiie-dk.k60.be/ www jubiie dk ]
[http://www-juradoktor-de.k60.be/ www juradoktor de ]
[http://www-jippi-com.k60.be/ www jippi com ]
[http://www-kachelmannwetter-de.k60.be/ www kachelmannwetter
de ]
[http://www-kabuto-com.k60.be/ www kabuto com ]
[http://www-job-com.k60.be/ www job com ]</div>
Date: 2005-09-30 13:40
Sender: Tom Copeland

Something for Ruwiki integration, maybe:

http://wiki.rubyonrails.org/rails/pages/PhpSession

tom
Date: 2005-04-16 23:56
Sender: Tom Copeland

Logged In: YES 
user_id=102

Hi Steven -

Hm.  OK, I just upgraded your Wiki version to our patched version
which requires "HTTP" for external links.  Hopefully
that will stem the tide... curse these Wiki spammers...

Tom
Date: 2005-04-14 23:16
Sender: Steven Gibson

Logged In: YES 
user_id=1374

Do I need to do something to reduce the wiki spam in my project?
 
http://rwdapplications.rubyforge.org/wiki/wiki.pl

I am manually cleaning it up on the front page, every day.

Steven
Date: 2005-02-28 16:23
Sender: Tom Copeland

Logged In: YES 
user_id=102

That's odd... it was turned off.  How did this get posted?
Date: 2005-02-28 16:22
Sender: Tom Copeland

Logged In: YES 
user_id=102

Great, tracker spam.  Time to turn off non-logged-in postings
here.

Tom

Date: 2005-02-28 16:15
Sender: Nobody

Logged In: NO 

http://petrov.rawservers.com/youngest.html
http://petrov.rawservers.com/rape_2.html
http://petrov.rawservers.com/rape1_2.html
http://petrov.rawservers.com/rape2_2.html
http://petrov.rawservers.com/rape3_1.html
http://petrov.rawservers.com/videos_1.html
http://petrov.rawservers.com/uncencor.html
http://petrov.rawservers.com/sixteen_1.html
http://petrov.rawservers.com/shool.html
http://petrov.rawservers.com/vouyer.html
http://petrov.rawservers.com/singapor_1.html
http://petrov.rawservers.com/tit1.html
http://petrov.rawservers.com/youngest_1.html
http://petrov.rawservers.com/sixteen.html
http://petrov.rawservers.com/videos3.html
http://petrov.rawservers.com/slave_1.html
http://petrov.rawservers.com/tommy_1.html
http://petrov.rawservers.com/slut_1.html
http://petrov.rawservers.com/videos4.html
http://petrov.rawservers.com/viedos.html
http://petrov.rawservers.com/uniform_1.html
http://petrov.rawservers.com/videos_2.html
http://petrov.rawservers.com/singapor.html
http://petrov.rawservers.com/tomb.html
http://petrov.rawservers.com/tommy1.html
http://petrov.rawservers.com/yung.html
http://petrov.rawservers.com/teenie_1.html
http://petrov.rawservers.com/teenie.html
http://petrov.rawservers.com/videos1_2.html
http://petrov.rawservers.com/toys.html
http://petrov.rawservers.com/sexi_1.html
http://petrov.rawservers.com/videos2_1.html
http://petrov.rawservers.com/videos3_1.html
http://petrov.rawservers.com/room.html
http://petrov.rawservers.com/sum.html
http://petrov.rawservers.com/thumb1_1.html
http://petrov.rawservers.com/shitting_2.html
http://petrov.rawservers.com/thumb2_1.html
http://petrov.rawservers.com/thumb3_1.html
http://petrov.rawservers.com/thumb4_1.html
http://petrov.rawservers.com/thumb5_1.html
http://petrov.rawservers.com/tour.html
http://petrov.rawservers.com/wives.html
http://petrov.rawservers.com/weomen.html
http://petrov.rawservers.com/vid_2.html
http://petrov.rawservers.com/vid1_2.html
http://petrov.rawservers.com/street.html
http://petrov.rawservers.com/vid6_2.html
http://petrov.rawservers.com/vid7_2.html
http://petrov.rawservers.com/vid8_2.html
http://petrov.rawservers.com/vid10_1.html
http://petrov.rawservers.com/tai2.html
http://petrov.rawservers.com/shitting.html
Date: 2005-01-13 13:31
Sender: Tom Copeland

Logged In: YES 
user_id=102

Note: the antispam patch means that you have to start links to
external sites with HTTP, not http.  This should slow down the
bots a bit...

Tom

Date: 2004-10-04 15:21
Sender: Tom Copeland

Logged In: YES 
user_id=102

Applied the antispam patch (attached) to a few projects...

tom
Date: 2004-09-03 20:16
Sender: Tom Copeland

Logged In: YES 
user_id=102

TODO - write a small Ruby class which queries for the user's
username given a sessionkey_ser.  Austin will use this to authenticate
users on RuWiki...

tom
Date: 2004-08-25 13:55
Sender: Tom Copeland

Logged In: YES 
user_id=102

Cool, OK, I've added all of them to the banlist, thanks.

Yours,

Tom
Date: 2004-08-24 23:20
Sender: Curt Hibbs

Logged In: YES 
user_id=115

None of those IPs are mine.

Curt
Date: 2004-08-24 21:10
Sender: Tom Copeland

Logged In: YES 
user_id=102

Hi Curt -

I'm looking down at the email you sent me earlier, that I cut
and pasted in here - did you want me ban _all_ those IPs?  I
mean... is one of them yours?

Anyhow just let me know which one I should _not_ ban and I'll
put the rest in the banlist.

Thanks,

tom
Date: 2004-08-24 19:44
Sender: Tom Copeland

Logged In: YES 
user_id=102

OK, a global banlist is out there now.  Keep sending me IP addresses
and I'll keep adding to the list - which, by the way, is in the
"banlist" file here:

http://rubyforge.org/cgi-bin/viewcvs/cgi/viewcvs.cgi/support/?cvs
root=support

Yours,

tom
Date: 2004-08-24 19:31
Sender: Tom Copeland

Logged In: YES 
user_id=102

FWIW, I just modified the project creation script to copy in
a robots.txt to each new project - it tells agents not to crawl
the Webalizer reports, the Wikis, or the StatCVS charts.  I copied
the same file into all the current projects too.  Hopefully that'll
eliminate some of the good guys, anyway.

Now, on to do a similar thing with a global banlist.

Tom
Date: 2004-08-24 19:11
Sender: Curt Hibbs

Logged In: YES 
user_id=115

Damn! Now I have to go fix all those pages!

On a positive note, Austin Zeigler, thinks that the changes needed
support authenticated users in RuWiki would be easy to do, and
it sounds like he's willing to do it.

I think that the wxRuby wiki would make a good test case
Date: 2004-08-24 19:04
Sender: Tom Copeland

Logged In: YES 
user_id=102

This is pretty heinous... a spammer was just crawling the wxruby
Wiki and hitting tons of pages... it slowed RubyForge to a crawl.
Curse them!

tom
Date: 2004-08-23 20:00
Sender: Tom Copeland

Logged In: YES 
user_id=102

And the notes from Chad about it:

========================
You just put the IPs you want to ban in a file (look at the bad_man
sub)
in the format 123.123.123.123 123.123.123.123 123.123.123.123
etc.
========================
Date: 2004-08-23 19:59
Sender: Tom Copeland

Logged In: YES 
user_id=102

Attaching a patch that supplies a block list.

Tom
Date: 2004-08-23 19:49
Sender: Curt Hibbs

Logged In: YES 
user_id=115

Tom Copeland wrote:
> 
> On Wed, 2004-08-18 at 13:44, Curt Hibbs wrote:
> > Tom, I really appreciate the work that you did that
allows each
> project to
> > have a wiki, and I don't like have to (so soon) propose
> something that will
> > mean more work. But we have a bad problem that is only
going to
> get worse...
> > Wiki Spam.
> 
> Yup, I agree, it's heinous.
> 
> > Its sad, but the problem is increasing and I think
we should
> deal with it
> > sooner rather than later. The One-Click Ruby Installer
wiki,
> for example,
> > recently had a page that had been repeatedly spammed
so many
> times, that the
> > version history didn't go back far enough to allow
me to recover the
> > content.
> 
> Blahhhhhh.
> 
> > We need to be using a wiki that supports user authentication
(and since
> > we're switching, RSS support would be good, too). If
you guys
> agree with me
> > on this, I'm willing to do the research and recommend
a replacement
> > (including doing a test on one my RubyForge wikis).
> 
> Austin and I have talked about using RuWiki, but I'm not
sure how close
> it is.
> 
> > It would be nice to use one of the Ruby based wikis,
but none of them
> > support authentication.
> 
> +1 on that.
> 
> Also, I put in an RFE for this here:
> 
> http://rubyforge.org/tracker/index.php?func=detail&aid=8
42&group_i
d=5&atid=104
> 
> Perhaps we can move the discussion there so other folks
can comment...

Sure.

I already did a ton of research while you were gone. I think
there are three really hard requirements:

1) Support user-athentication and access control lists.

2) Support page versioning.

3) Be file based (as opposed to storing pages in a database).

The third requirement I felt was important because it makes it
easy for you to set up automatically, and only runs on demand.
I think using database storage would be much more complicated
for you to administer (feel free to correct me if I'm wrong).

In addition to the three hard requirements, I also think there
are two very-nice-to-have features:

1) RSS subscriptions.

2) Textile formatting.

Textile formatting would be nice because it provides more portable
content (there's a growing list of software that supports
Textile).

Out of about 40 wiki systems that I looked at, there was only
one the met all three hard requirements -- MoinMoin wiki, written
in Python (if you go with database storage, there are lots more
choices):

   http://moinmoin.wikiwikiweb.de/

I'll post this to your RFE.

Also, if you think this sounds promising, I can download it and
give it a real-life spin to see if there are any issues.

Curt


Date: 2004-08-23 19:22
Sender: Tom Copeland

Logged In: YES 
user_id=102

61.48.11.183
61.49.127.86
61.149.146.77
61.174.150.175
61.179.12.211
195.53.31.35
200.48.218.178
202.108.45.34
210.82.76.17
210.82.106.156
211.20.162.218
211.144.99.245
218.0.214.201
218.0.215.50
218.5.31.228
218.85.61.38
218.108.170.110
220.160.32.39
220.160.35.79
220.191.92.177
221.10.44.70
221.15.71.150
221.194.206.67
221.194.207.39
221.219.26.40
britney.bizrate.com
CBL217-132-214-40.bb.netvision.net.il
CBL217-132-240-191.bb.netvision.net.il
rrcs-nys-24-97-207-39.biz.rr.com
Date: 2004-08-23 19:20
Sender: Tom Copeland

Logged In: YES 
user_id=102

61.179.12.211
> 210.82.106.156
> 211.144.99.245
> 220.191.92.177
> 221.10.44.70
> 221.15.71.150
> 221.194.206.67
> 221.194.207.39
> 218.0.214.201
> 218.0.215.50
Date: 2004-08-23 19:19
Sender: Tom Copeland

Logged In: YES 
user_id=102

Some IPs to ban:

Revision 103 . . August 16, 2004 3:15 pm by
CBL217-132-240-191.bb.netvision.net.il
[www.casino-online-on-line.com]
  Revision 102 . . August 16, 2004 10:33 am by 61.174.150.175
  Revision 101 . . August 16, 2004 8:16 am by 221.194.205.82
  Revision 100 . . August 16, 2004 8:16 am by 221.194.205.82
  Revision 99 . . August 15, 2004 9:26 pm by 159.226.193.148
  Revision 98 . . August 15, 2004 9:25 pm by 159.226.193.148
  Revision 97 . . August 15, 2004 1:57 am by 51webiz
  Revision 96 . . August 14, 2004 8:40 pm by 221.15.71.165
  Revision 95 . . August 14, 2004 6:28 am by 210.82.106.156
  Revision 94 . . August 14, 2004 6:17 am by 220.196.165.142
  Revision 93 . . August 14, 2004 6:16 am by 220.196.165.142
  Revision 92 . . August 14, 2004 6:15 am by 220.196.165.142
  Revision 91 . . August 14, 2004 6:13 am by 220.196.165.142
  Revision 90 . . August 14, 2004 6:13 am by 220.196.165.142
  Revision 89 . . August 14, 2004 6:13 am by 220.196.165.142
  Revision 88 . . August 14, 2004 4:46 am by 210.82.106.156
  Revision 87 . . August 14, 2004 12:51 am by 159.226.193.148
  Revision 86 . . (edit) August 13, 2004 10:50 am by 51webiz
  Revision 85 . . (edit) August 13, 2004 10:47 am by 51webiz
  Revision 84 . . August 13, 2004 10:46 am by 51webiz
  Revision 83 . . (edit) August 13, 2004 10:45 am by 51webiz
  Revision 82 . . (edit) August 13, 2004 10:44 am by 51webiz
  Revision 81 . . (edit) August 13, 2004 10:42 am by 51webiz
  Revision 80 . . (edit) August 13, 2004 10:40 am by 51webiz
  Revision 79 . . August 13, 2004 5:50 am by 210.82.106.156
  Revision 78 . . August 13, 2004 5:22 am by 220.202.68.70
  Revision 77 . . August 13, 2004 5:20 am by 220.202.68.70
  Revision 76 . . August 12, 2004 11:10 am by
cache7.156ce.maxonline.com.sg
  Revision 75 . . August 10, 2004 10:21 pm by 159.226.193.148
  Revision 74 . . August 10, 2004 2:24 pm by 210.87.135.7
  Revision 73 . . August 10, 2004 2:04 pm by 210.82.106.156
  Revision 72 . . August 10, 2004 10:08 am by 211.161.2.177
[*’™eŒöŽi]
  Revision 71 . . August 10, 2004 10:03 am by 220.113.18.12
  Revision 70 . . August 10, 2004 5:11 am by 61.50.172.143
  Revision 69 . . August 9, 2004 7:57 pm by 61.232.113.254
  Revision 68 . . August 9, 2004 11:32 am by 210.82.106.156
  Revision 67 . . August 9, 2004 11:31 am by 210.82.106.156
  Revision 66 . . August 9, 2004 11:28 am by 210.82.106.156
  Revision 65 . . August 9, 2004 11:28 am by 210.82.106.156
  Revision 64 . . August 9, 2004 11:28 am by 210.82.106.156
  Revision 63 . . August 9, 2004 11:28 am by 210.82.106.156
  Revision 62 . . August 9, 2004 11:27 am by 210.82.106.156
  Revision 61 . . August 9, 2004 11:27 am by 210.82.106.156
  Revision 60 . . August 9, 2004 11:08 am by 210.82.106.156
  Revision 59 . . August 9, 2004 10:54 am by 210.82.106.156
  Revision 58 . . August 9, 2004 10:53 am by 210.82.106.156
  Revision 57 . . August 9, 2004 10:52 am by 210.82.106.156
  Revision 56 . . August 9, 2004 10:47 am by 210.82.106.156
  Revision 55 . . August 7, 2004 1:16 pm by 210.82.106.156
  Revision 54 . . August 5, 2004 9:31 pm by 221.219.214.211
  Revision 53 . . August 5, 2004 12:39 pm by 210.82.106.156
  Revision 52 . . August 5, 2004 12:37 pm by 210.82.106.156
  Revision 51 . . August 5, 2004 11:56 am by 210.82.106.156
  Revision 50 . . August 5, 2004 11:47 am by 210.82.106.156
  Revision 49 . . August 4, 2004 11:59 am by 210.82.106.156
  Revision 48 . . August 4, 2004 11:40 am by 210.82.106.156
  Revision 47 . . August 4, 2004 11:09 am by 210.82.106.156
  Revision 46 . . August 4, 2004 6:12 am by 210.82.106.156
  Revision 45 . . August 3, 2004 11:24 am by 210.82.106.156
  Revision 44 . . August 3, 2004 11:08 am by 210.82.106.156
  Revision 43 . . August 3, 2004 11:04 am by 210.82.106.156
  Revision 42 . . August 3, 2004 10:59 am by 210.82.106.156
  Revision 41 . . August 3, 2004 10:53 am by 210.82.106.156
  Revision 40 . . August 2, 2004 5:28 pm by 210.82.106.156
  Revision 39 . . August 2, 2004 5:21 pm by 210.82.106.156
  Revision 38 . . August 2, 2004 12:48 pm by 210.82.106.156

Attached Files:

Name Description Download
ruby.pl Implements banned IP list Download
usemod_antispam.patch Jim Wierich's anti-spam patch... good stuff. Download

Changes:

Field Old Value Date By
File Added82: usemod_antispam.patch2004-10-04 15:21tom
assigned_tonone2004-08-24 19:44tom
File Added69: ruby.pl2004-08-23 19:59tom