From tom at infoether.com  Mon Nov 20 10:45:08 2006
From: tom at infoether.com (Tom Copeland)
Date: Mon, 20 Nov 2006 10:45:08 -0500
Subject: [Support-admins] [Fwd: Re: rubyforge & mirrors]
Message-ID: <1164037508.485.151.camel@bugs.hal>

OK, I've got the mirror's gem index rebuilding once each day; should be
sufficient for a backup.  

So now we've got some manual gem redundancy... it's a start...

Yours,

Tom

-------- Forwarded Message --------
> From: Tom Copeland <tom at infoether.com>
> To: ruby-talk at ruby-lang.org
> Subject: Re: rubyforge & mirrors
> Date: Mon, 20 Nov 2006 10:42:04 -0500
> 
> On Mon, 2006-11-20 at 09:17 -0500, Tom Copeland wrote:
> > > isn't it time to build some kind of redunancy into gem?
> > 
> > Yup, that's in the works too.
> 
> OK, now you can install gems from one of the gem mirrors; just use:
> 
> ===================
> gem install --source http://gems.rubyforge.vm.bytemark.co.uk some_gem
> ===================
> 
> I've posted this on my "rubyforge down" blog entry as well.
> 
> Thanks to Bytemark for continuing to host this mirror!
> 
> Yours,
> 
> Tom
> 


From tom at infoether.com  Mon Nov 27 12:08:07 2006
From: tom at infoether.com (Tom Copeland)
Date: Mon, 27 Nov 2006 12:08:07 -0500
Subject: [Support-admins] Mailman config
Message-ID: <001d01c71246$9c759230$0301000a@tomhplaptop>

Hi all -

Anyone have any experience tuning Mailman?  If so, please take a look at
the custom settings here:

http://rubyforge.org/viewvc/trunk/support/mm_cfg.py?view=log

QRUNNERS: This seems to keep the outgoing and the retry queues down to
reasonable lengths - about 20 or so outgoing and 50-60 in retry.  

QRUNNER_SLEEP_TIME: This setting vs the default (every second) seems to
help keep the load down.

SMTP_MAX_RCPTS: I hear tell that keeping this low prevents the emails
from getting rejected by some ISPs.  

If anyone knows any more settings which are usually tweaked for
medium-sized Mailman sites, please let me know.  We've got about 450
lists now and are doing 10K-15K messages per day, most of which are on
the lists.

Thanks,

Tom


From tom at infoether.com  Mon Nov 27 14:15:33 2006
From: tom at infoether.com (Tom Copeland)
Date: Mon, 27 Nov 2006 14:15:33 -0500
Subject: [Support-admins] Making a mirroring change
Message-ID: <000201c71258$6a128890$0301000a@tomhplaptop>

Hi Dennis and all -

Hey, I'm going to make a file mirroring change on the rubyforge end.
Here's the way it works now:

- every 20 minutes a script checks the /var/www/gforge-files directory
to see if there are any new files
- if there are, it uses cp -u to copy the file into a parallel directory
tree at /usr/local/mirror/ 
- then it hits the /sync URL, the files get sync'd out, etc

Here's what I want to change it to:

- every 20 minutes the script will do a du -sk on /var/www/gforge-files
and compare it to a cached version in a file
- if the result changes, hit the sync script

So I need to rewrite my script and point the "file-mirror" rsync to
/var/www/gforge-files vs /usr/local/mirror.

This will save about of 5 GB disk space on rubyforge, and more
importantly it will reduce disk I/O as I'll need to do less scanning.
It'll also fix this bug:

http://rubyforge.org/tracker/index.php?func=detail&aid=5286&group_id=5&a
tid=101

I don't think you'll see any changes on your end, so just kind of wanted
to let you and anyone else on this list know what was going on.
Comments/questions welcome,

Yours,

Tom


From tom at infoether.com  Tue Nov 28 08:43:30 2006
From: tom at infoether.com (Tom Copeland)
Date: Tue, 28 Nov 2006 08:43:30 -0500
Subject: [Support-admins] Upgrade to svn 1.4?
Message-ID: <1164721410.16674.54.camel@bugs.hal>

Some folks are running into compatibility problems when they're hitting
RubyForge with their svn 1.4 clients since we're running svn 1.3.  The
upgrade sounds pretty painless:

http://subversion.tigris.org/svn_1.4_releasenotes.html

Any comments on or objection to upgrading?

Yours,

tom


From tom at infoether.com  Tue Nov 28 10:26:21 2006
From: tom at infoether.com (Tom Copeland)
Date: Tue, 28 Nov 2006 10:26:21 -0500
Subject: [Support-admins] Went ahead and upgraded to svn 1.4.2....
Message-ID: <001801c71301$8fac5780$0301000a@tomhplaptop>

....all seems well, but if anyone notices anything awry, please holler.

Thanks,

Tom


From tom at infoether.com  Tue Nov 28 11:16:50 2006
From: tom at infoether.com (Tom Copeland)
Date: Tue, 28 Nov 2006 11:16:50 -0500
Subject: [Support-admins] Making a mirroring change
Message-ID: <008201c71308$9cdfd790$0301000a@tomhplaptop>

OK, I've rewritten the script and the rsync from the new location is
running now... 

Tom

> -----Original Message-----
> From: Tom Copeland [mailto:tom at infoether.com] 
> Sent: Monday, November 27, 2006 2:16 PM
> To: 'support-admins at rubyforge.org'
> Subject: Making a mirroring change
> 
> 
> Hi Dennis and all -
> 
> Hey, I'm going to make a file mirroring change on the 
> rubyforge end.  Here's the way it works now:
> 
> - every 20 minutes a script checks the /var/www/gforge-files 
> directory to see if there are any new files
> - if there are, it uses cp -u to copy the file into a 
> parallel directory tree at /usr/local/mirror/ 
> - then it hits the /sync URL, the files get sync'd out, etc
> 
> Here's what I want to change it to:
> 
> - every 20 minutes the script will do a du -sk on 
> /var/www/gforge-files and compare it to a cached version in a file
> - if the result changes, hit the sync script
> 
> So I need to rewrite my script and point the "file-mirror" 
> rsync to /var/www/gforge-files vs /usr/local/mirror.
> 
> This will save about of 5 GB disk space on rubyforge, and 
> more importantly it will reduce disk I/O as I'll need to do 
> less scanning.  It'll also fix this bug:
> 
http://rubyforge.org/tracker/index.php?func=detail&aid=5286&group_id=5&a
tid=101

I don't think you'll see any changes on your end, so just kind of wanted
to let you and anyone else on this list know what was going on.
Comments/questions welcome,

Yours,

Tom


From tom at infoether.com  Tue Nov 28 11:47:33 2006
From: tom at infoether.com (Tom Copeland)
Date: Tue, 28 Nov 2006 11:47:33 -0500
Subject: [Support-admins] Making a mirroring change
Message-ID: <008b01c7130c$e76a7f00$0301000a@tomhplaptop>

OK, this new setup seems like it's working fine.  It only takes a second
to check for new files (vs a rather IO intensive 10-20 seconds the old
way), so I'm going to increase the frequency of checks from every 20
minutes to every 10 minutes.  So new releases will get sync'd out
faster.  Good times!

Tom



> -----Original Message-----
> From: Tom Copeland [mailto:tom at infoether.com] 
> Sent: Tuesday, November 28, 2006 11:17 AM
> To: 'support-admins at rubyforge.org'
> Subject: RE: Making a mirroring change
> 
> 
> OK, I've rewritten the script and the rsync from the new 
> location is running now... 
> 
> Tom
> 
> > -----Original Message-----
> > From: Tom Copeland [mailto:tom at infoether.com]
> > Sent: Monday, November 27, 2006 2:16 PM
> > To: 'support-admins at rubyforge.org'
> > Subject: Making a mirroring change
> > 
> > 
> > Hi Dennis and all -
> > 
> > Hey, I'm going to make a file mirroring change on the
> > rubyforge end.  Here's the way it works now:
> > 
> > - every 20 minutes a script checks the /var/www/gforge-files
> > directory to see if there are any new files
> > - if there are, it uses cp -u to copy the file into a 
> > parallel directory tree at /usr/local/mirror/ 
> > - then it hits the /sync URL, the files get sync'd out, etc
> > 
> > Here's what I want to change it to:
> > 
> > - every 20 minutes the script will do a du -sk on
> > /var/www/gforge-files and compare it to a cached version in a file
> > - if the result changes, hit the sync script
> > 
> > So I need to rewrite my script and point the "file-mirror"
> > rsync to /var/www/gforge-files vs /usr/local/mirror.
> > 
> > This will save about of 5 GB disk space on rubyforge, and
> > more importantly it will reduce disk I/O as I'll need to do 
> > less scanning.  It'll also fix this bug:
> > 
> http://rubyforge.org/tracker/index.php?func=detail&aid=5286&gr
oup_id=5&atid=101

I don't think you'll see any changes on your end, so just kind of wanted
to let you and anyone else on this list know what was going on.
Comments/questions welcome,

Yours,

Tom


From tom at infoether.com  Tue Nov 28 15:47:53 2006
From: tom at infoether.com (Tom Copeland)
Date: Tue, 28 Nov 2006 15:47:53 -0500
Subject: [Support-admins] mod_cache for /export/
Message-ID: <00b301c7132e$7c982e80$0301000a@tomhplaptop>

Hi all -

I just set up mod_cache for /export; details are here:

http://tomcopeland.blogs.com/juniordeveloper/2006/11/apaches_mod_cac.htm
l

Questions/comments welcome,

Yours,

Tom