[Blacklight-development] more little importer tricks
Jason Ronallo
jronallo at gmail.com
Thu May 1 15:24:02 EDT 2008
Jonathan,
Yes, I was able to index records successfully (well, mostly, but
that's another thread). I used the OSU bib records up at archive.org
as one of the sets I indexed. (Search "collection:ol_data marc"
methinks) But that's a lot of records for a test.
If you look in /blacklight_importer/blacklight.properties you'll see
what MARC fields are mapped to which solr fields. Any MARC21 records
ought to work for a test of the indexer.
I did not use the shell script. I invoked the importer directly with
something like:
java -Xmx1024M -jar dist/MarcImporter.jar importSamples.properties
I didn't have 1024M of RAM so I changed that number. Otherwise as long
as I had importSamples.properties configured correctly it worked fine.
Jason
> If you have a chance (no hurry really), would appreciate you checking the
> sample script to make sure it does a commit and works for _anyone_. But I
> guess Jaron has used it succesfully?
>
> Jonathan
>
> Matt Mitchell wrote:
>
> >
> >
> >
> > Yeah I'd do what Jason suggested. I wonder if the script didn't execute a
> > commit. You should still be able to see some kind of indicator in the solr
> > admin:
> >
> > http://localhost:8983/solr/admin/stats.jsp
> >
> > Matt
> >
> > On Thu, May 1, 2008 at 2:40 PM, Jason Ronallo <jronallo at gmail.com> wrote:
> >
> >
> >
> > > Jonathan,
> > > Have you started up solr?
> > > >From within the trunk/rails directory you can run: rake solr_int:start
> > > to start solr + jetty
> > > Then you can go to http://localhost:8983/solr/admin (I think that's
> > > the correct port)
> > > do the query: [* TO *]
> > > and see what your results are.
> > >
> > > At least that's what I'd try.
> > >
> > > Jason
> > >
> > > On Thu, May 1, 2008 at 2:32 PM, Jonathan Rochkind <rochkind at jhu.edu>
> > > wrote:
> > >
> > >
> > > > 1. On unix, you've got to re-save index_file.sh with unix line endings
> > > >
> > > >
> > > (or
> > >
> > >
> > > > at least the first line), so it will find the interpreter properly
> > > >
> > > >
> > > instead
> > >
> > >
> > > > of saying:
> > > >
> > > > -bash: ./index_file.sh: /bin/sh^M: bad interpreter: No such file or
> > > > directory
> > > >
> > > > 2. The sample file name given in GettingStarted.txt is not quite
> right.
> > > > NOT:
> > > > ./index_file.sh sample_records/selected_recs.mrc
> > > >
> > > >
> > > importSamples.properties
> > >
> > >
> > > > BUT INSTEAD:
> > > > ./index_file.sh sample_records/selectedRecs.mrc
> > > >
> > > >
> > > importSamples.properties
> > >
> > >
> > > > With that, it SAYS it indexed the files---but they don't seem to
> > > >
> > > >
> > > actually
> > >
> > >
> > > > show up in my blacklight installation. I pointed solr.path in
> > > > importSamples.properties at the solr that's embedded with blacklight,
> > > >
> > > >
> > > that's
> > >
> > >
> > > > right, right? Hmm, how do I confirm that these 8 records actually ARE
> in
> > > > blacklight? Blacklight used to show ALL records as it's default
> screen,
> > > >
> > > >
> > > but
> > >
> > >
> > > > I don't think it does anymore--nor is it showing ANY facets on the
> home
> > > > page, like it used to. Does this mean that I for some reason haven't
> in
> > > >
> > > >
> > > fact
> > >
> > >
> > > > succesfully imported the records?
> > > >
> > > > Thanks all.
> > > >
> > > > Jonathan
> > > >
> > > > --
> > > > Jonathan Rochkind
> > > > Digital Services Software Engineer
> > > > The Sheridan Libraries
> > > > Johns Hopkins University
> > > > 410.516.8886 rochkind (at) jhu.edu
> > > >
> > > > _______________________________________________
> > > > Blacklight-development mailing list
> > > > Blacklight-development at rubyforge.org
> > > > http://rubyforge.org/mailman/listinfo/blacklight-development
> > > >
> > > >
> > > >
> > > _______________________________________________
> > > Blacklight-development mailing list
> > > Blacklight-development at rubyforge.org
> > > http://rubyforge.org/mailman/listinfo/blacklight-development
> > >
> > >
> > >
> >
> > ------------------------------------------------------------------------
> >
> >
> > _______________________________________________
> > Blacklight-development mailing list
> > Blacklight-development at rubyforge.org
> > http://rubyforge.org/mailman/listinfo/blacklight-development
> >
> >
>
> --
>
> Jonathan Rochkind
> Digital Services Software Engineer
> The Sheridan Libraries
> Johns Hopkins University
> 410.516.8886 rochkind (at) jhu.edu
>
> _______________________________________________
> Blacklight-development mailing list
> Blacklight-development at rubyforge.org
> http://rubyforge.org/mailman/listinfo/blacklight-development
>
More information about the Blacklight-development
mailing list