[OPEN-ILS-DEV] RE: [OPEN-ILS-GENERAL] Importing Bibliographic Information

[Sperr, Edwin]

I wanted to throw in a hearty "me too!" on Karen's question as I hadn't
seen an answer posted yet.  I've got 30,000 test records to play with,
but I'm not going to bother attempting an import unless I can add the
items as part of the batch load (I love the staff client, but that's too
many mouse clicks to do it by hand...)

It seems like there *should* be a simple way to say "852|a mugtwn =
Muggletown Public Library" somewhere in the flags for pg_loader.pl or by
setting something in config.cgi, but I have yet to find it.  

Anyone care to share the secret sauce?

Thanks!

Ed Sperr
sperr at nelinet.net 

-----Original Message-----
From: open-ils-general-bounces at list.georgialibraries.org
[mailto:open-ils-general-bounces at list.georgialibraries.org] On Behalf Of
Karen Collier
Sent: Wednesday, August 22, 2007 3:52 PM
To: open-ils-general at list.georgialibraries.org;
open-ils-dev at list.georgialibraries.org
Subject: RE: [OPEN-ILS-GENERAL] Importing Bibliographic Information

We tried importing MARC records with the copy/item info in the
field/subfields suggested below.  They imported fine, but only as MARC
data.
The information didn't find its way into the Evergreen tables to allow
copy information to display in the OPAC or staff client as copy
information.  Any idea what I have to do differently to make locations,
barcodes, collections, etc get into the right tables to be used by the
system, so it actually displays that there are copies available at the
various locations where they are available?  

I've been studying the entity relationship diagram at
http://open-ils.org/documentation/evergreen_1.1.3_erd.html and I'm
pretty sure I've figured out what tables this info needs to go into.
I'm just stuck as far as *how* to get it in.  Does pg_loader.pl need to
be edited to make sql statements putting info for each record into the
appropriate tables?  Or am I just confusing myself?

Any hints or help would be appreciated.

Thanks,
Karen


-----Original Message-----
From: open-ils-general-bounces at list.georgialibraries.org
[mailto:open-ils-general-bounces at list.georgialibraries.org] On Behalf Of
Deanna Frazee
Sent: Thursday, July 26, 2007 3:50 PM
To: open-ils-general at list.georgialibraries.org
Subject: RE: [OPEN-ILS-GENERAL] Importing Bibliographic Information

We set up the export_target table in Horizon to use the following
subfields for the test data:

b=Location
c=Collection
k=Call
t=Copy
x=Notes
z=CKI_notes 

As you have probably noted, we did not take all of the data we should
have--particularly price, vendor and current status.  This was just a
test run, and we just wanted to take enough to let us see how things
were going to look.  OCLC has a complete list of what should go in each
subfield of the
852 at www.oclc.org/bibformats/en/8xx/852.shtm.

So far, we just haven't had time to look at transferring patron data,
but I hope we will have time to do that in late August.  If anyone has
some spare time they can loan me....

Deanna Frazee
Killeen City Library System
(254) 501-8995
(254) 501-7704 (fax)
dfrazee at ci.killeen.tx.us
 

> -----Original Message-----
> From: open-ils-general-bounces at list.georgialibraries.org
[mailto:open-ils-
> general-bounces at list.georgialibraries.org] On Behalf Of Jason
Stephenson
> Sent: Thursday, July 26, 2007 2:03 PM
> To: open-ils-general at list.georgialibraries.org
> Subject: Re: [OPEN-ILS-GENERAL] Importing Bibliographic Information
> 
> Don, et al.,
> 
> Thanks for the information about the 852 tag. This is very helpful.
> 
> I have so far tried importing about 850,000 bib records into Evergreen

> from our Horizon database, and the process did not go well.
Apparently,
> our Core 2 Duo with 4 GB of RAM cannot handle processing all 850,000 
> bibs at once, so I will have to break it up into chunks.
> 
> I'm wondering if you have any benchmarks for how much RAM/CPU
resources
> the conversion programs use per X number of records. The 
> direct_ingest.pl on my test machine segfaulted after about 250,000 
> records. I'm assuming that I'll need to load them in batches of 50,000

> to 100,000 to be successful.
> 
> Also, for Deanna, I have a specific question. Can you tell me what 
> parameters you used for your export target in Horizon to get your item

> info into the 852, please? I'm looking at this for our consoritum
right
> now and while I have some ideas, it would save me a lot of time
teasing
> it out if I had someone else's to look at.
> 
> Cheers,
> Jason
>