[OPEN-ILS-GENERAL] Importing Bibliographic Information

[Karen Collier]

We tried importing MARC records with the copy/item info in the
field/subfields suggested below.  They imported fine, but only as MARC data.
The information didn't find its way into the Evergreen tables to allow copy
information to display in the OPAC or staff client as copy information.  Any
idea what I have to do differently to make locations, barcodes, collections,
etc get into the right tables to be used by the system, so it actually
displays that there are copies available at the various locations where they
are available?  

I've been studying the entity relationship diagram at
http://open-ils.org/documentation/evergreen_1.1.3_erd.html and I'm pretty
sure I've figured out what tables this info needs to go into.  I'm just
stuck as far as *how* to get it in.  Does pg_loader.pl need to be edited to
make sql statements putting info for each record into the appropriate
tables?  Or am I just confusing myself?

Any hints or help would be appreciated.

Thanks,
Karen


-----Original Message-----
From: open-ils-general-bounces at list.georgialibraries.org
[mailto:open-ils-general-bounces at list.georgialibraries.org] On Behalf Of
Deanna Frazee
Sent: Thursday, July 26, 2007 3:50 PM
To: open-ils-general at list.georgialibraries.org
Subject: RE: [OPEN-ILS-GENERAL] Importing Bibliographic Information

We set up the export_target table in Horizon to use the following subfields
for the test data:

b=Location
c=Collection
k=Call
t=Copy
x=Notes
z=CKI_notes 

As you have probably noted, we did not take all of the data we should
have--particularly price, vendor and current status.  This was just a test
run, and we just wanted to take enough to let us see how things were going
to look.  OCLC has a complete list of what should go in each subfield of the
852 at www.oclc.org/bibformats/en/8xx/852.shtm.

So far, we just haven't had time to look at transferring patron data, but I
hope we will have time to do that in late August.  If anyone has some spare
time they can loan me....

Deanna Frazee
Killeen City Library System
(254) 501-8995
(254) 501-7704 (fax)
dfrazee at ci.killeen.tx.us
 

> -----Original Message-----
> From: open-ils-general-bounces at list.georgialibraries.org
[mailto:open-ils-
> general-bounces at list.georgialibraries.org] On Behalf Of Jason
Stephenson
> Sent: Thursday, July 26, 2007 2:03 PM
> To: open-ils-general at list.georgialibraries.org
> Subject: Re: [OPEN-ILS-GENERAL] Importing Bibliographic Information
> 
> Don, et al.,
> 
> Thanks for the information about the 852 tag. This is very helpful.
> 
> I have so far tried importing about 850,000 bib records into Evergreen 
> from our Horizon database, and the process did not go well.
Apparently,
> our Core 2 Duo with 4 GB of RAM cannot handle processing all 850,000 
> bibs at once, so I will have to break it up into chunks.
> 
> I'm wondering if you have any benchmarks for how much RAM/CPU
resources
> the conversion programs use per X number of records. The 
> direct_ingest.pl on my test machine segfaulted after about 250,000 
> records. I'm assuming that I'll need to load them in batches of 50,000 
> to 100,000 to be successful.
> 
> Also, for Deanna, I have a specific question. Can you tell me what 
> parameters you used for your export target in Horizon to get your item 
> info into the 852, please? I'm looking at this for our consoritum
right
> now and while I have some ideas, it would save me a lot of time
teasing
> it out if I had someone else's to look at.
> 
> Cheers,
> Jason
>