[OPEN-ILS-GENERAL] Import issues

Dibyendra Hyoju dibyendra at gmail.com
Thu Aug 6 01:30:23 EDT 2009


Hello everyone,

Today, I again tried to import a new set of parallel records, which I
thought there would be no errors. But, I am getting messages like 'Use of
uninitialized value $value in substitution (s///) at marc2bre.pl line 412.'
repeatedly while executing 'perl marc2bre.pl --db_user evergreen --db_host
localhost --db_pw evergreen --db_name evergreen 5300.mrc > ~/5300.bre'.

I continued converting the bre into ingest file ignoring the message. But I
got error like 'Couldn't process record...'. I've attached the error message
herewith as the error message was very long, and a record which I had tried
is also attached herewith. If anyone has faced similar problems and had
already found the solution, please suggest. I would be very much thankful.

Any help will be appreciated.

Thank you.

With kind regards,
Dibyendra


On Wed, Aug 5, 2009 at 5:06 PM, Dibyendra Hyoju <dibyendra at gmail.com> wrote:

> Hi all,
>
> I have finished installing Evergreen 1.4 on Debian-lenny, and trying to
> import MARC records. I have successfully imported the gutenberg records as
> shown in the Importing bibliographic records<http://open-ils.org/dokuwiki/doku.php?id=evergreen-admin:importing:bibrecords>.
> But, I couldn't do the same for our library <http://madanpuraskar.org/>records
> which have both local script and roman transliteration. I am getting lots of
> similar warnings while converting the MARC records into Evegreen BRE JSON
> format. Like I am getting 'no mapping found for [0xCC] at position 3 in
> Bhārgav Bhūshaṇ Presa) g0=ASCII_DEFAULT g1=EXTENDED_LATIN at
> /usr/share/perl5/MARC/Charset.pm line 210.'  while executing 'perl
> marc2bre.pl --db_user evergreen --db_host localhost --db_pw evergreen
> --db_name evergreen 8500.mrc > ~/8500.bre'. Though, it generates Open-ILS
> JSON ingest file after executing perl direct_ingest.pl ~/8000.bre >
> ~/8000.ingest'.  But, it couldn't generate a SQL file after executing 'perl
> pg_loader.pl -or bre -or mrd -or mfr -or mtfe -or mafe -or msfe -or mkfe -or
> msefe -a mrd -a mfr -a mtfe -a mafe -a msfe -a mkfe -a msefe
> --output=~/8500.sql < ~/8500.ingest'. I followed the same process for the
> gutenberg records and they were successfully imported.
>
> I've also attached the file containing some of our library records if
> somebody is interested to import the records for testing. If it can be
> imported by any other methods, please let me know. Any help will be highly
> appreciated.
>
> Thank you.
>
> --
> Dibyendra Hyoju
> Madan Puraskar Pustakalaya
> Lalitpur, Nepal
>
>
>
>
>
>


-- 
Dibyendra
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20090806/8c2dd038/attachment-0001.htm 
-------------- next part --------------
 >>> {"__c":"bre","__p":[null,null,null,null,null,"t","now",1,"f","now",1,null,"14458","IMPORT-1249535985.07914","<record    xmlns:xsi=\"http://www.w3.org/2001/XMLSchema-instance\"    xsi:schemaLocation=\"http://www.loc.gov/MARC21/slim http://www.loc.gov/ standards/marcxml/schema/MARC21slim.xsd\"    xmlns=\"http://www.loc.gov/MARC21/slim\"><leader>00967nam a2200193Ka 4500</leader><controlfield tag=\"008\">090121s1968    np            000 0 nep d  </controlfield><datafield tag=\"020\" ind1=\" \" ind2=\" \"><subfield code=\"c\">nil</subfield></datafield><datafield tag=\"245\" ind1=\"0\" ind2=\"0\"><subfield code=\"a\">&#x915;&#x943;&#x937;&#x93F; &#x935;&#x93F;&#x915;&#x93E;&#x938;&#x915;&#x93E; &#x932;&#x93E;&#x917;&#x93F; &#x92A;&#x94D;&#x930;&#x926;&#x93E;&#x928; &#x917;&#x930;&#x93F;&#x928;&#x947; &#x90B;&#x923;.</subfield></datafield><datafield tag=\"245\" ind1=\"0\" ind2=\"0\"><subfield code=\"a\">Kr&#x323;shi vika&#x304;saka&#x304; la&#x304;gi prada&#x304;na garine r&#x323;n&#x323;a.</subfield></datafield><datafield tag=\"250\" ind1=\" \" ind2=\" \"><subfield code=\"a\">[&#x92A;&#x939;&#x93F;&#x932;&#x94B;]</subfield></datafield><datafield tag=\"250\" ind1=\" \" ind2=\" \"><subfield code=\"a\">[Pahilo]</subfield></datafield><datafield tag=\"260\" ind1=\" \" ind2=\" \"><subfield code=\"a\">&#x915;&#x93E;&#x920;&#x92E;&#x93E;&#x921;&#x94C;&#x902; :</subfield><subfield code=\"b\">&#x915;&#x943;&#x937;&#x93F; &#x935;&#x93F;&#x915;&#x93E;&#x938; &#x92C;&#x948;&#x902;&#x915;,</subfield><subfield code=\"c\">2025 [1968]</subfield><subfield code=\"e\">(&#x915;&#x93E;&#x920;&#x92E;&#x93E;&#x921;&#x94C;&#x902; :</subfield><subfield code=\"f\">&#x91C;&#x94B;&#x930;&#x917;&#x923;&#x947;&#x936; &#x92A;&#x94D;&#x930;&#x947;&#x938;)</subfield></datafield><datafield tag=\"260\" ind1=\" \" ind2=\" \"><subfield code=\"a\">Ka&#x304;t&#x323;hama&#x304;d&#x323;aum&#x323; :</subfield><subfield code=\"b\">Kr&#x323;shi Vika&#x304;sa Bain&#x307;ka,</subfield><subfield code=\"c\">2025 [1968]</subfield><subfield code=\"e\">(Ka&#x304;t&#x323;hama&#x304;d&#x323;aum&#x323; :</subfield><subfield code=\"f\">Joragan&#x323;es&#x301;a Presa)</subfield></datafield><datafield tag=\"300\" ind1=\" \" ind2=\" \"><subfield code=\"a\">20 p. :</subfield><subfield code=\"c\">17 cm.</subfield></datafield><datafield tag=\"500\" ind1=\" \" ind2=\" \"><subfield code=\"a\">Cover title.</subfield></datafield><datafield tag=\"520\" ind1=\" \" ind2=\" \"><subfield code=\"a\">Introduction to Agriculture Development Bank and different types of loans the bank is providing.</subfield></datafield><datafield tag=\"546\" ind1=\" \" ind2=\" \"><subfield code=\"a\">In Nepali.</subfield></datafield><datafield tag=\"650\" ind1=\" \" ind2=\"0\"><subfield code=\"a\">Economics.</subfield><subfield code=\"v\">Unknown.</subfield></datafield><datafield tag=\"852\" ind1=\" \" ind2=\" \"><subfield code=\"a\">Madan Puraskar Pustakalaya</subfield><subfield code=\"e\">Patandhoka, Lalitpur, Nepal</subfield><subfield code=\"x\">Accession no.: 5309</subfield></datafield><datafield tag=\"901\" ind1=\" \" ind2=\" \"><subfield code=\"a\">s14458</subfield><subfield code=\"b\">System</subfield><subfield code=\"c\">14458</subfield></datafield></record>",null,null,"System","s14458"]}

Couldn't process record: invalid character encountered while parsing JSON string, at character offset 18 ["\x{15}M$>(, \x{15}C7..."] at /usr/local/share/perl/5.10.0/OpenSRF/Utils/JSON.pm line 126.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 5300.mrc
Type: application/octet-stream
Size: 121751 bytes
Desc: not available
Url : http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20090806/8c2dd038/attachment-0001.obj 


More information about the Open-ils-general mailing list