[Boulder-Denver Ruby Group] Ara's lightning talk at RubyConf

ara.t.howard at noaa.gov ara.t.howard at noaa.gov
Thu Nov 2 10:09:19 EST 2006


On Wed, 1 Nov 2006, Kevin Williams wrote:

> Hello Ara,

hi kevin-

> I saw your lightning talk at RubyConf; nice job!  Did you build your
> distributed environment on DRb or Rinda?

believe it or not, neither!  it's 100% nfs based.  although that may seem like
an odd choice it buys a bunch of features

   - no (new) ports need opened.  nfs is about the only thing that can get
     through our firewalls so this makes us able to install and configure
     clusters with zero admin intervention.

   - nfs has the nice property that it hangs (on the client) when the server
     goes down rather than dropping the connection.  just last week we rebooted
     our central server and it took about 1.5 days to come back up (fsck on
     giant disks) and all the jobs on 30 nodes simply froze until it was fully
     functional again.

   - typically one needs a central code location that's shared anyhow: we
     install all code and configuration on this central nfs server so and
     upgrade of ruby, for instance, is instantly available on all nodes. our
     nodes have nothing but a user account and a crontab, which lets us bring
     them online from scratch in literally minutes: there is no software
     installed locally.

   - the nfs model is more easily understood by less technical operators since
     it's operation is an abstraction of the filesystem and that is well
     understood by any operator

you can read more about it, (slightly) out-dated, here

   http://www.linuxjournal.com/article/7922

fyi - i'm just about to release a new version.  if you are planning on playing
with rq let me know and i'll send you a pre-release.

cheers.

-a
-- 
my religion is very simple.  my religion is kindness. -- the dalai lama


More information about the Bdrg-members mailing list