[OPEN-ILS-GENERAL] REL 2.10 and export non-imported records

Thu Aug 11 17:37:01 EDT 2016

Hi Dan,

I’m not exactly sure how to explain this. When I change the extension in Vandelay to .mrc and export out the non-imported records I get all of them. I have a file with 106 non-imported records.  I want to open and use my file in MARCedit so this is working for me, the file has all 106 records.

When I simply export out the buggy XML ones I get all of them if I open the file in Notepad++, the unfit for human consumption file.  If I select to use the Office XML Handler to open the file, no file is visible. There if I click on File>Save as, I get the file name and can give the file the .mrc extension even though it’s not one of choices. When I do that and open the file in MARCedit,  I get only a portion of the file.  The first time I did this the first record was quite long and that’s the only record I got. I just tried this again and the records were shorter in length, so this time I got 5 of the 106 records. I got all 106 when changing the file extension in Vandelay.

The XML choices in Vandelay are Webpage, source only(.xml, .xht, xhtml, .svg) or .txt.  If I give the file the .xml extension it just opens another blank page, the bug again. If I give it the .txt extension nothing is there, either as a text file or opening in Excel.

Janet

Janet Schrader
Bibliographic Services Supervisor
C/W MARS Inc.
67 Millbrook Street, Suite 201
Worcester, MA 01606
Tel: 508-755-3323 ext. 325
Fax: 508-757-7801
jschrader at cwmars.org<mailto:jschrader at cwmars.org>

From: Open-ils-general [mailto:open-ils-general-bounces at list.georgialibraries.org] On Behalf Of Dan Wells
Sent: Thursday, August 11, 2016 4:08 PM
To: Evergreen Discussion Group <open-ils-general at list.georgialibraries.org>
Subject: Re: [OPEN-ILS-GENERAL] REL 2.10 and export non-imported records

Hello Janet,

Yes, as Rogan explains, the file output is not actually XML, it is an alternative binary format used for MARC records.  The screenshot you gave from Notepad++ is showing you the “raw” contents of this file, which, as you can see, it not meant for human consumption :)

Very few programs can open and understand binary MARC files, but MARCedit is one that can.  If you name your file with the “.mrc” extension, it will (by default) be associated with MARCedit, and you can right-click on the file and choose “Preview MARC File” to get MARCedit’s custom, editable, more human-friendly view.  You can also load the file into MARC Tools, and there use either MarcBreaker (to get a text file in MARCedit’s custom text format) or convert straight to MARCXML (listed as MARC21XML).

The bugfix does not change the actual output, only the file extension.  Both before and after the bugfix, the output from Evergreen will be binary MARC.  I am concerned about the part of your message indicating you are only getting one record.  Please let me know if that is still the case once you get it open in MARCedit.

Sincerely,
Dan

Daniel Wells
Library Programmer/Analyst
Hekman Library, Calvin College
616.526.7133

From: Open-ils-general [mailto:open-ils-general-bounces at list.georgialibraries.org] On Behalf Of Rogan Hamby
Sent: Thursday, August 11, 2016 3:27 PM
To: Evergreen Discussion Group <open-ils-general at list.georgialibraries.org<mailto:open-ils-general at list.georgialibraries.org>>
Subject: Re: [OPEN-ILS-GENERAL] REL 2.10 and export non-imported records

Hi Janet,

The issue is that it's not a MARC XML file.  The extension is in error and in fact Dan submitted a patch (yesterday?) to fix that and make the extension .mrc.  To my knowledge .mrc isn't an official extension but it pretty widely recognized.  I would recommend changing it to .mrc or .marc and since you're already using MARC Edit you can use it to change it to MARC XML if you want to.

On Thu, Aug 11, 2016 at 3:09 PM, Janet Schrader <jschrader at cwmars.org<mailto:jschrader at cwmars.org>> wrote:
Hi Dan,

Thanks for the reply.  I am able to change the file extension to .mrc by choosing the ‘all files’ and then typing in the extension in the blank box. I want to be able to open files in MARCedit where I can make changes to the file or export out an Excel list of titles and ISBNS, etc.  When I load files of online resources I often find duplicate matches on existing records. I want to give a list of these for my staff to resolve. If there are a few I write down the numbers. In some files there may be 50-100 records. Right now I am rearranging the queue view (but that’s another story for another development idea) and taking a screenshot of twenty records at a time, about the maximum I can get on one screen. Then I load on ‘best’ match. Being able to have the system create a file or list of non-imported records will be a big help timesaver.

If I export out as XML I can open it in Notepad++.  I found that trying to open it with the default Office XML Handler, which is what is opening the MARC Mapping to MODS, I don’t see anything. If I click on File>save as, I can save a .mrc file but it only saves the first record. I’ve used Notepad++ to make Evergreen brief record templates so I’m familiar with MARC in that XML format. I just can’t get Vandelay exported file to open in XML.  Is that because it’s really a non-XML file, the bug you reported?

My Notepad++ file looks like this:
[cid:image001.jpg at 01D1F3F0.52F5B4F0]

Instead of like this:
[cid:image002.jpg at 01D1F3F0.52F5B4F0]

Thanks again,
Janet

Janet Schrader
Bibliographic Services Supervisor
C/W MARS Inc.
67 Millbrook Street, Suite 201
Worcester, MA 01606
Tel: 508-755-3323 ext. 325<tel:508-755-3323%20ext.%20325>
Fax: 508-757-7801<tel:508-757-7801>
jschrader at cwmars.org<mailto:jschrader at cwmars.org>

From: Open-ils-general [mailto:open-ils-general-bounces at list.georgialibraries.org<mailto:open-ils-general-bounces at list.georgialibraries.org>] On Behalf Of Dan Wells
Sent: Tuesday, August 9, 2016 3:42 PM

To: Evergreen Discussion Group <open-ils-general at list.georgialibraries.org<mailto:open-ils-general at list.georgialibraries.org>>
Subject: Re: [OPEN-ILS-GENERAL] REL 2.10 and export non-imported records

Hello Janet,

It appears a late change to that feature did not get fully implemented.  It originally exported as MARC-XML, but was changed to export as MARC21 instead.  However, the dialog box still includes the “.xml” extension by default.

If you manually change the extension to something more MARC-like (e.g. “.mrc”), it may behave more reliably.  Ultimately, though, it depends on what software you want to use to edit the file, and how that software will interpret the contents of the file.  If you have the option, tell the software that the file is in MARC21 format.

In any case, I will open a bug about the “.xml” default, since giving a non-XML file an “.xml” extension is never going to be a good idea.

Sincerely,
Dan

Daniel Wells
Library Programmer/Analyst
Hekman Library, Calvin College
616.526.7133<tel:616.526.7133>

From: Open-ils-general [mailto:open-ils-general-bounces at list.georgialibraries.org] On Behalf Of Remington Steed
Sent: Tuesday, August 09, 2016 8:38 AM
To: Evergreen Discussion Group <open-ils-general at list.georgialibraries.org<mailto:open-ils-general at list.georgialibraries.org>>
Subject: Re: [OPEN-ILS-GENERAL] REL 2.10 and export non-imported records

Hi Janet,

You aren’t doing anything wrong.  This feature exports a MARCXML file, which is suitable for importing via the same MARC Batch Import interface.  You can simply save the file and reimport it (with different settings, or after editing the records if you wish).

Feel free to reply if you have more questions.

Remington

--
Remington Steed
Electronic Resources Specialist
Hekman Library, Calvin College
http://library.calvin.edu/

From: Open-ils-general [mailto:open-ils-general-bounces at list.georgialibraries.org] On Behalf Of Janet Schrader
Sent: Monday, August 08, 2016 5:45 PM
To: open-ils-general at list.georgialibraries.org<mailto:open-ils-general at list.georgialibraries.org>
Subject: [OPEN-ILS-GENERAL] REL 2.10 and export non-imported records

Hi,

I’m testing REL 2.10:
8.3.2. Quickly export non-imported records
When inspecting a queue in MARC Batch Import/Export, there is now a link to download to MARC file any records in the queue that were not imported into the catalog. This allows catalogers to quickly manipulate the records that failed to import using an external tool, then attempt to import them again.

How does this work? The file extension seems to be for XML.
[cid:image003.png at 01D1F3F0.52F5B4F0]

I’m saving to my desktop where the icon appears to be MARC to MODS mapping??
[cid:image004.png at 01D1F3F0.52F5B4F0][cid:image005.png at 01D1F3F0.52F5B4F0]

I have been waiting for this development for four years, two months, and one week (but who’s counting). I really appreciate any help on what I’m doing wrong.

Thanks!
Janet

Janet Schrader
Bibliographic Services Supervisor
C/W MARS Inc.
67 Millbrook Street, Suite 201
Worcester, MA 01606
Tel: 508-755-3323 ext. 325<tel:508-755-3323%20ext.%20325>
Fax: 508-757-7801<tel:508-757-7801>
jschrader at cwmars.org<mailto:jschrader at cwmars.org>

--
--------------------------------------------------------------
Rogan R. Hamby, Data and Project Analyst
Equinox - Open Your Library
rogan at esilibrary.com<mailto:rogan at esilibrary.com>
1-877-OPEN-ILS | www.esilibrary.com<http://www.esilibrary.com>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20160811/3b5db4a8/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 55076 bytes
Desc: image001.jpg
URL: <http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20160811/3b5db4a8/attachment-0002.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 13863 bytes
Desc: image002.jpg
URL: <http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20160811/3b5db4a8/attachment-0003.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 2817 bytes
Desc: image003.png
URL: <http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20160811/3b5db4a8/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 12282 bytes
Desc: image004.png
URL: <http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20160811/3b5db4a8/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 3317 bytes
Desc: image005.png
URL: <http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20160811/3b5db4a8/attachment-0005.png>