[OPEN-ILS-GENERAL] Books only coming up by TCN

[Mike Rylander]

On Wed, Jul 8, 2009 at 12:06 PM, Dan Scott<denials at gmail.com> wrote:
> Can you pull up the record, get the record number, and try reingesting
> it based on the record number?
>
> We've seen a similar (might be the same) problem (PostgreSQL 8.3,
> Evergreen almost 1.6) and wrote a simple script that tries to reingest
> any records for which there are no corresponding
> metabib.keyword_field_entry entries on a regular basis.
>
> The problem in our case seems to be with the
> reporter.simple_rec_sync() function finding a duplicate ID, which
> theoretically shouldn't happen. Some sort of a race condition,
> probably. It's quite annoying. And a related concern is that once a
> record has been ingested, once it has been edited there's no guarantee
> (while this problem exists) that the edited record will be reingested
> and have the updates reflected in the index.
>
> The script we run on an hourly basis is
> http://svn.open-ils.org/trac/ILS-Contrib/browser/conifer/trunk/tools/reingest_uningested.pl

If up-to-the-minute reporting with data from the materialized
simple-record view is not needed, and instead you just need, say,
nightly reports of the previous days cataloging, you could simply
disable the trigger:

  SELECT reporter.disable_materialized_simple_record_trigger();

and then, every night from cron, after the cataloging department
closes, run these (in this order):

    SELECT reporter.enable_materialized_simple_record_trigger();
    SELECT reporter.disable_materialized_simple_record_trigger();

That will refresh a static view of the data from a nightly snapshot,
but avoid the batch of updates that occurs every time a record is
updated, which seems to be the cause of the ingest issue.

If anyone would like to put some eyes on those stored procedures, they
live in Open-ILS/src/sql/Pg/reporter-schema.sql.  The most relevant on
is  reporter.simple_rec_sync() ... I'd appreciate someone taking a
look.

--miker

>
> Dan
>
> 2009/7/8 Adam Ray <aray at slcconline.edu>:
>> We are just beginning using Evergreen to input our catalog. I have been able
>> to import our existing records and now we are beginning the process of
>> continuing our electronic catalog. We have begun to notice that some books
>> can be called by the TCN but no other fields work. I can pull up the record
>> by TCN and click on the author and still return zero results.
>>
>> Here is our MARC record:
>>
>> LDR00771nam 2200253 i 4500
>> 0011744088
>> 00520090708154547.0
>> 008760128s1975 nyua b 001 0 eng
>> 035
>> . ‡9(DLC) 75018649
>> 906
>> . ‡a7 ‡bcbc ‡corignew ‡d2 ‡eocip ‡f19 ‡gy-gencatlg
>> 010
>> . ‡a75018649
>> 040
>> . ‡aDLC ‡cDLC ‡dDLC
>> 049
>> . ‡aYZ7M
>> 05000. ‡aHQ1061 ‡b.B715
>> 08200. ‡a301.43/4
>> 09200. ‡a301.434 ‡bB798a 1975
>> 1001 . ‡aBradbury, Wilbur.
>> 24514. ‡aThe adult years / ‡cby Wilbur Bradbury and the editors of Time-Life
>> Books.
>> 260
>> . ‡aNew York : ‡bTime-Life Books, ‡cc1975.
>> 300
>> . ‡a176 p. : ‡bill. ; ‡c27 cm.
>> 4900 . ‡aHuman behavior
>> 504
>> . ‡aBibliography: p. 170-171.
>> 500
>> . ‡aIncludes index.
>> 650
>> 0. ‡aAdulthood.
>> 650
>> 0. ‡aGeneral studies.
>> 7102 . ‡aTime-Life Books.
>> 991
>> . ‡bc-GenColl ‡hHQ1061 ‡i.B715 ‡tCopy 1 ‡wBOOKS
>>
>>
>>
>> Adam Ray
>> SLCC IT Director
>> (314) 837-6777 x1250
>>
>
>
>
> --
> Dan Scott
> Laurentian University
>



-- 
Mike Rylander
 | VP, Research and Design
 | Equinox Software, Inc. / The Evergreen Experts
 | phone:  1-877-OPEN-ILS (673-6457)
 | email:  miker at esilibrary.com
 | web:  http://www.esilibrary.com