[OPEN-ILS-DEV] direct_ingest error

[Doug Kyle]

We're still trying to figure this out.  Maybe this snippet from the Perl 
debugger will help someone familiar with the code to point us in the 
right direction.

OpenSRF::Application::run(/openils/lib/perl5//OpenSRF/Application.pm:540):
540:                    $resp = $code->($self, $req, @params);
  DB<1> s
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object(/openils/lib/perl5//OpenILS/Application/Ingest.pm:335):
335:            my $self = shift;
  DB<1> n
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object(/openils/lib/perl5//OpenILS/Application/Ingest.pm:336):
336:            my $client = shift;
  DB<1>
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object(/openils/lib/perl5//OpenILS/Application/Ingest.pm:337):
337:            my $bib = shift;
  DB<1>
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object(/openils/lib/perl5//OpenILS/Application/Ingest.pm:338):
338:            my $xml = 
OpenILS::Application::Ingest::entityize($bib->marc);
  DB<1>
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object(/openils/lib/perl5//OpenILS/Application/Ingest.pm:340):
340:            my $document = $parser->parse_string($xml);
  DB<1>
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object(/openils/lib/perl5//OpenILS/Application/Ingest.pm:342):
342:            my @mfr = 
$self->method_lookup("open-ils.ingest.flat_marc.biblio.xml")->run($document);
  DB<1>
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object(/openils/lib/perl5//OpenILS/Application/Ingest.pm:343):
343:            my @mXfe = 
$self->method_lookup("open-ils.ingest.extract.field_entry.all.xml")->run($document);
  DB<1>
Undefined namespace prefix
xmlXPathCompiledEval: evaluation failed
 at /usr/local/lib/perl/5.8.8/XML/LibXML.pm line 824
        
XML::LibXML::Node::findnodes('XML::LibXML::Element=SCALAR(0x3391740)', 
'//marc:datafield[@tag="907"]/marc:subfield[@code="b"]') called at 
/openils/lib/perl5//OpenILS/Application/Ingest.pm line 682
        
OpenILS::Application::Ingest::XPATH::xpath_to_string('XML::LibXML::Element=SCALAR(0x3391740)', 
'//marc:datafield[@tag="907"]/marc:subfield[@code="b"]', 'undef', 
'marc', 1) called at /openils/lib/perl5//OpenILS/Application/Ingest.pm 
line 726
        
OpenILS::Application::Ingest::XPATH::class_index_string_xml('OpenILS::Application::Ingest::XPATH=HASH(0x2233b00)', 
'OpenSRF::AppSubrequest=HASH(0x32c67a0)', 
'XML::LibXML::Document=SCALAR(0x33323b0)', 'keyword', 'subject', 
'author', 'title', 'series') called at 
/openils/lib/perl5//OpenSRF/Application.pm line 540
        
OpenSRF::Application::run('OpenILS::Application::Ingest::XPATH=HASH(0x2233b00)', 
'XML::LibXML::Document=SCALAR(0x33323b0)', 'keyword', 'subject', 
'author', 'title', 'series') called at 
/openils/lib/perl5//OpenILS/Application/Ingest.pm line 791
        
OpenILS::Application::Ingest::XPATH::all_index_string_xml('OpenILS::Application::Ingest::XPATH=HASH(0x2233fc0)', 
'OpenSRF::AppSubrequest=HASH(0x2f8ea20)', 
'XML::LibXML::Document=SCALAR(0x33323b0)') called at 
/openils/lib/perl5//OpenSRF/Application.pm line 540
        
OpenSRF::Application::run('OpenILS::Application::Ingest::XPATH=HASH(0x2233fc0)', 
'XML::LibXML::Document=SCALAR(0x33323b0)') called at 
/openils/lib/perl5//OpenILS/Application/Ingest.pm line 343
        
OpenILS::Application::Ingest::Biblio::ro_biblio_ingest_single_object('OpenILS::Application::Ingest::Biblio=HASH(0x2232b60)', 
'OpenSRF::AppSubrequest=HASH(0x335cb00)', 
'Fieldmapper::biblio::record_entry=ARRAY(0x334bf90)') called at 
/openils/lib/perl5//OpenSRF/Application.pm line 540
        
OpenSRF::Application::run('OpenILS::Application::Ingest::Biblio=HASH(0x2232b60)', 
'Fieldmapper::biblio::record_entry=ARRAY(0x334bf90)') called at 
/openils/bin/direct_ingest.pl line 64


Bill Ott wrote:
>
>> The namespaces in your BRE appear to match the various samples of BRE
>> that I have on my system, so I don't think it's a problem with
>> marc2bre.pl. I think that's pretty stock output for yaz-marcdump.
>>   
> Yep, took them to another server and direct_ingest.pl handles them 
> fine :-(
> Too bad.  I'm using a hacked up marc2bre.pl, checking for isbn and tcn 
> matches before adding them to the mix, so I was hoping I broke it myself.
>
>> Perhaps it's a problem with the level of libxml2 / libxslt /
>> XML::LibXML / XML::LibXSLT that you have installed on your system? For
>> what it's worth, settings-tester.pl tells me I have:
>>
>> XML::LibXML version 1.63
>> XML::LibXML::XPathContext version 1.63
>> XML::LibXSLT version 1.62
>>
>> I have libxml2.so.2.6.31 and libxslt.so.1.1.22 installed in /usr/lib.
>>   
> Been round and round with different versions, still no love.
>
>> Another possibility is that your stylesheets in /openils/var/xsl are
>> corrupted (or perhaps opensrf.xml isn't pointing to them)? The
>> OpenILS::Application::Ingest module pulls in the MARC21slim2MODS and
>> MARC21slim2MODS3 stylesheets as part of the ingest process.
>>   
> Re-copied them, ...nada.
>
>> I also wondered whether it might be a problem in the database
>> configuration (e.g. a lack of pgxml support) but that seems quite
>> unlikely.
>> Sorry for not having a definitive answer for you :( but perhaps this
>> will help you poke around.
>>
>>   
>
> The kicker to all this is, that I previously imported over 360,000 
> bibs on this machine without error.  I can't figure out what's changed 
> since then.  The server is up and running and all other functions seem 
> fine.  I did my development on another server where I had it working 
> well, moved it to this box and hit a wall.