[sup-devel] importing your sup email into heliotrope
michael+sup at stapelberg.de
Sun Jan 8 15:37:25 EST 2012
Excerpts from William Morgan's message of 2011-12-30 20:31:24 +0000:
> 3. Import your mail sources into heliotrope. Mbox and maildir sources
> should go pretty quick; IMAP, as usual, will be very slow. For each
> source you can do this:
> $HELIOTROPE_DIR> ruby -Ilib bin/heliotrope-import --dir <mailstore dir> --sup-dumpfile <dumpfile> --mbox <mbox file>
I think you meant --sup-label-file, or you did not push some commits yet :).
> Or replace "--mbox <mbox file>" with the corresponding argument to
> your source (use --help to see them all).
FYI: I used the following command to get all my sources in one command line:
$ grep uri .sup/sources.yaml | sed 's/^[ \t]*uri: maildir://g' | tr '\n' ' '
The total time for importing was:
; scanned 133872, indexed 122314, skipped 9485 bad and 2073 seen messages in 12484.5s = 10.7 m/s
Which is awfully long. I took a look at the process list and saw lots of
html2text process running. Why are they run at all? Are they also run for
plain-text emails? Most of my emails surely are plain-text, without any need to
> 5. Finally, reorder the index so that messages appear in order:
> $HELIOTROPE_DIR> ruby -Ilib bin/heliotrope-reindex --reorder --dir <mailstore dir>
> $HELIOTROPE_DIR> mv <mailstore dir>/index <mailstore dir>/index-old
> $HELIOTROPE_DIR> mv <mailstore dir>/index-reindexed <mailstore dir>/index
Ugh, this took a lot of time, too:
; reindexed 120451 messages, skipped 0 spam and 1863 deleted in 9509.3s = 12.7 m/s
Also, the numbers don’t add up. This is a bit confusing. Is there maybe no
printing of the *final* status? Or is this intended?
More information about the Sup-devel