[Rake-devel] rake speedup for several thousand tasks

Gavin Sinclair gsinclair at soyabean.com.au
Tue Mar 30 23:53:21 EST 2004

On Monday, March 29, 2004, 5:31:33 AM, Jim wrote:

> Niklas von Öhsen wrote:
>> I just got acquainted to rake and want to use it to automate
>> some scientific calculations (I think, its great!). This involves 
>> definition of several thousand tasks. I found that the usual rake "file"
>> and "task" syntax is quite slow for this. Thus I added new methods for a
>> faster task definition. The original time needed for the definition of
>> about 7000 file tasks with one additional dependence was 150 sec. Using
>> the code below this goes down to 1.2 sec. A speedup of more than 10000% :-)
>> It sacrifices flexibility and beauty of syntax to raw speed, but if that
>> is what you need ...

> Sorry it took so long to respond to this.  Your performance numbers are
> interesting and certainly is worth further investigation.  I've not 
> tried more than a rew hundred dependencies at a time.  Thanks for the
> feedback!

I've noticed a slowdown in a Rake file of mine where there are a lot
of files to be zipped up (I think that's what caused it).  The
annoying thing is that "rake" is slow to start up even when I'm asking
it to do a simple task.

Some lazy evaluation might help :)


More information about the Rake-devel mailing list