[Evergreen-catalogers] Unable to import large batches of bibs

[Judith MacNeil]

This issue is resolved and I thought I would share it with you.
I am well aware that the maximum number of bibs in a batch to import should
not exceed 500. Our last version of Evergreen was able to upload and import
1000 at a time. So I tried with our new version of 3.4.1.

What we discovered was that the total size of each batch could not exceed 1
MB.  This explained why I could work with 500 Proquest bibs, but not 500
OCLC records. The batches I was working with are described below:

Successful Proquest batches of 500
I was able to import batches of 500 bibs from Proquest .Their sizes ranged
from 659 KB to 923 KB.Unsuccessful OCLC batches of 500 that would not upload
OCLC New records were split into batches of 500 ranged in size from 1.7 to
2 MB and would not upload.Successful OCLC Batch of 250
When split into batches of 250 records, their sizes were generally in the
range of 787-974 KB and I was able to upload them.Unsuccessful OCLC Batch
of 250
OCLC Updates were split into batches of 250. It is 1.2 MB.

We asked our support at Equinox to look into this. They bumped the 1 MB
limit to 10 MB ....it's an nginx config ( this is new for 3.4.1 ).
Everything is working as it should.

Regards,

Judith MacNeil

Library Technician - Cataloguing and Metadata


Robertson Library
University of Prince Edward Island
550 University Ave, Charlottetown, PE Canada C1A 4P3
E-mail:   judithmacneil at upei.ca
Telephone:  902-566-0531 <(902)%566-0531>
Library Web Page http://library.upei.ca




On Tue, 14 Jan 2020 at 11:49, Judith MacNeil <judithmacneil at upei.ca> wrote:

> Hello all,
> I am getting an error message when attempting to import batches of 1000 or
> 500 bibs. If I break it down further to 250 it enqueues and imports Is
> anyone else experiencing this problem? I am using the Chrome browser..
>
> [image: Screen Shot 2020-01-06 at 9.09.22 AM.png]
>
>
>
> Judith MacNeil
>
> Library Technician - Cataloguing and Metadata
>
>
> Robertson Library
> University of Prince Edward Island
> 550 University Ave, Charlottetown, PE Canada C1A 4P3
> E-mail:   judithmacneil at upei.ca
> Telephone:  902-566-0531 <(902)%566-0531>
> Library Web Page http://library.upei.ca
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://list.evergreen-ils.org/pipermail/evergreen-catalogers/attachments/20200116/9c0ef6ac/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screen Shot 2020-01-06 at 9.09.22 AM.png
Type: image/png
Size: 64648 bytes
Desc: not available
URL: <http://list.evergreen-ils.org/pipermail/evergreen-catalogers/attachments/20200116/9c0ef6ac/attachment-0001.png>