[OPEN-ILS-DEV] Data load challenges

Don Hamilton dhamilton at wlu.ca
Thu Jul 5 11:40:38 EDT 2007


Thanks, Mike. I'll dowload and test the new version.... I just about had
the begin/commit ready to submit as a patch, but ended up corrupting my
install elsewhere and couldn't actually test it, and hadn't quite got
back to that yet...
 
Maybe this is the time to ask... If I could get access to write to the
docuwiki, I'd be happy to tweak the notes at
http://open-ils.org/dokuwiki/doku.php?id=evergreen-admin:importing:bibrecords
with some of the nuances I've found...
 
I can't devote as much time as I'd like to this, but I will give back
when I can.
 
don

>>> "Mike Rylander" <mrylander at gmail.com> 7/5/2007 11:32 AM >>>

On 7/5/07, Don Hamilton <dhamilton at wlu.ca> wrote:
> Thanks Mike.
>
>  I added a couple of lines to pg-loader (to print "BEGIN" / "COMMIT"
> statements) and removed the 'ticker'. My line 86 is:
>
>         my $fields = join(',', @{ $fieldcache{$h}{fields} });
>
> Do I have a set of records that is missing subject data? I do have
the
> author data in the sql file, followed by the .\. I DON'T have the
copy for
> the COPY for metalib.subject_field_entry.

Hmm... I think you're right.  I will protect against that (and add a
BEGIN/COMMIT).

...

UPDATE: Fix (and begin/commit) committed to svn.  You can just update
to that and not worry about missing data ... alternatively, you can
just remove the -or and -a options mentioning msfe from the command
line, though there may be others missing (msefe is for series, for
instance).

>
> AH... writing things down helps... I just reran the original 802
records,
> starting with record id 803, and that did not fail... so I think the
problem
> may be the that there are no subject fields in the oxford data...
which of
> the (many) parameters to pg-loader might I remove to NOT try to load
> subjects....
>

Very good catch, and thanks for the analysis.

--miker

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://list.georgialibraries.org/pipermail/open-ils-dev/attachments/20070705/8a894396/attachment-0001.html


More information about the Open-ils-dev mailing list