[Blacklight-development] more little importer tricks

Jason Ronallo jronallo at gmail.com
Thu May 1 15:24:02 EDT 2008


Jonathan,
Yes, I was able to index records successfully (well, mostly, but
that's another thread). I used the OSU bib records up at archive.org
as one of the sets I indexed. (Search "collection:ol_data marc"
methinks) But that's a lot of records for a test.

If you look in /blacklight_importer/blacklight.properties you'll see
what MARC fields are mapped to which solr fields. Any MARC21 records
ought to work for a test of the indexer.

I did not use the shell script. I invoked the importer directly with
something like:
java -Xmx1024M -jar dist/MarcImporter.jar importSamples.properties

I didn't have 1024M of RAM so I changed that number. Otherwise as long
as I had importSamples.properties configured correctly it worked fine.

Jason


>  If you have a chance (no hurry really), would appreciate you checking the
> sample script to make sure it does a commit and works for _anyone_. But I
> guess Jaron has used it succesfully?
>
>  Jonathan
>
>  Matt Mitchell wrote:
>
> >
> >
> >
> > Yeah I'd do what Jason suggested. I wonder if the script didn't execute a
> > commit. You should still be able to see some kind of indicator in the solr
> > admin:
> >
> > http://localhost:8983/solr/admin/stats.jsp
> >
> > Matt
> >
> > On Thu, May 1, 2008 at 2:40 PM, Jason Ronallo <jronallo at gmail.com> wrote:
> >
> >
> >
> > > Jonathan,
> > > Have you started up solr?
> > > >From within the trunk/rails directory you can run: rake solr_int:start
> > > to start solr + jetty
> > > Then you can go to http://localhost:8983/solr/admin (I think that's
> > > the correct port)
> > > do the query: [* TO *]
> > > and see what your results are.
> > >
> > > At least that's what I'd try.
> > >
> > > Jason
> > >
> > > On Thu, May 1, 2008 at 2:32 PM, Jonathan Rochkind <rochkind at jhu.edu>
> > > wrote:
> > >
> > >
> > > > 1. On unix, you've got to re-save index_file.sh with unix line endings
> > > >
> > > >
> > > (or
> > >
> > >
> > > > at least the first line), so it will find the interpreter properly
> > > >
> > > >
> > > instead
> > >
> > >
> > > > of saying:
> > > >
> > > >  -bash: ./index_file.sh: /bin/sh^M: bad interpreter: No such file or
> > > > directory
> > > >
> > > >  2. The sample file name given in GettingStarted.txt is not quite
> right.
> > > > NOT:
> > > >  ./index_file.sh sample_records/selected_recs.mrc
> > > >
> > > >
> > > importSamples.properties
> > >
> > >
> > > >  BUT INSTEAD:
> > > >  ./index_file.sh sample_records/selectedRecs.mrc
> > > >
> > > >
> > > importSamples.properties
> > >
> > >
> > > >  With that, it SAYS it indexed the files---but they don't seem to
> > > >
> > > >
> > > actually
> > >
> > >
> > > > show up in my blacklight installation. I pointed solr.path in
> > > > importSamples.properties at the solr that's embedded with blacklight,
> > > >
> > > >
> > > that's
> > >
> > >
> > > > right, right? Hmm, how do I confirm that these 8 records actually ARE
> in
> > > > blacklight?  Blacklight used to show ALL records as it's default
> screen,
> > > >
> > > >
> > > but
> > >
> > >
> > > > I don't think it does anymore--nor is it showing ANY facets on the
> home
> > > > page, like it used to. Does this mean that I for some reason haven't
> in
> > > >
> > > >
> > > fact
> > >
> > >
> > > > succesfully imported the records?
> > > >
> > > >  Thanks all.
> > > >
> > > >  Jonathan
> > > >
> > > >  --
> > > >  Jonathan Rochkind
> > > >  Digital Services Software Engineer
> > > >  The Sheridan Libraries
> > > >  Johns Hopkins University
> > > >  410.516.8886 rochkind (at) jhu.edu
> > > >
> > > >  _______________________________________________
> > > >  Blacklight-development mailing list
> > > >  Blacklight-development at rubyforge.org
> > > >  http://rubyforge.org/mailman/listinfo/blacklight-development
> > > >
> > > >
> > > >
> > > _______________________________________________
> > > Blacklight-development mailing list
> > > Blacklight-development at rubyforge.org
> > > http://rubyforge.org/mailman/listinfo/blacklight-development
> > >
> > >
> > >
> >
> >  ------------------------------------------------------------------------
> >
> >
> > _______________________________________________
> > Blacklight-development mailing list
> > Blacklight-development at rubyforge.org
> > http://rubyforge.org/mailman/listinfo/blacklight-development
> >
> >
>
>  --
>
>  Jonathan Rochkind
>  Digital Services Software Engineer
>  The Sheridan Libraries
>  Johns Hopkins University
>  410.516.8886 rochkind (at) jhu.edu
>
>  _______________________________________________
>  Blacklight-development mailing list
>  Blacklight-development at rubyforge.org
>  http://rubyforge.org/mailman/listinfo/blacklight-development
>


More information about the Blacklight-development mailing list