[OPEN-ILS-DEV] Unexpectedly dying of authority_control_fields script when parallel processing

[Repke de Vries]

Posting on behalf of Chris at IISH, Amsterdam (his dev-list message doesn't get through)
Repke de Vries, IISH

-----Original message-----
To:	open-ils-dev at list.georgialibraries.org; 
From:	Chris Roosendaal <c.roosendaal at ogd.nl>
Sent:	Tue 17-05-2011 17:37
Subject:	Unexpectedly dying of authority_control_fields script when parallel processing
 
Hello all,
 
We are running Evergreen 2.0.3. During the execution of the linking process between the bibliographic records and the authority records we encountered an unexpected error with the process dying. The error was generated by the authority_control_fields.pl script (see for version details: [1]) and is as follows (note that the lines starting with ‘> ‘ are generated by our shell script and not from the Perl script):
 
opensrf at evergreen2:~$ ./bibauthverband1.sh
> Process start 28 end 130000 started at Mon May 9 17:27:38 > CEST 2011
Exception: OpenSRF::DomainObject::oilsMethodException 2011-05-10T16:37:50 OpenILS::Utils::CStoreEditor /openils/lib/perl5//OpenILS/Utils/CStoreEditor.pm:411 <500>  No active transaction to commit
> Elapsed time for 28 130000 code block: 83419
> Finished up 28 130000 at Tue May 10 16:37:57 CEST 2011
opensrf at evergreen2:~$
 
Our shell script called bibauthverband1.sh code is:
 
opensrf at evergreen2:~$ cat bibauthverband1.sh
# Shell script that relates bibliographic records and authority records
# Shows Start-time, end-time, and elapsed time in seconds.

echo Process start 28 end 130000 started at $(date)
before="$(date +%s)"
PERL5LIB=/openils/lib/perl5/ perl ./authority_control_fields.pl  --start_id 28 --end_id 130000
after="$(date +%s)"
elapsed_seconds="$(expr $after - $before)"
echo Elapsed time for 28 130000 code block: $elapsed_seconds
echo Finished up 28  130000 at $(date)opensrf at evergreen2:~$
 
This script is the first script of eight more scripts. We started every script on a separate SSH session, with different start- and end IDs for every script.
 
My question is:
-          Are the errors due to the fact that we started the scripts in parallel on multiple SSH sessions, and the multiple invocations on the database from the authority_control_fields.pl script caused conflicts?
 
Thanks,
Chris Roosendaal
Developer IISG Amsterdam
 
 
 
[1]: This is an excerpt from an email from Dan Scott dated 19-4-2011:
... an updated version of

authority_control_fields.pl. The fixed version will be part of the

Evergreen 2.0.6 release, but you can download it from

http://svn.open-ils.org/trac/ILS/browser/trunk/Open-ILS/src/support-scripts

right away to continue testing the linking function.

.."
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://libmail.georgialibraries.org/pipermail/open-ils-dev/attachments/20110517/f7fc0965/attachment.htm