[OPEN-ILS-DEV] 3.0.0-betat1 database upgrade and reingest

[Josh Stompro]

> -----Original Message-----
> From: Open-ils-dev [mailto:open-ils-dev-bounces at list.georgialibraries.org] On Behalf Of Jason Stephenson
> Sent: Thursday, September 21, 2017 6:43 PM
> To: open-ils-dev at list.georgialibraries.org
> Subject: Re: [OPEN-ILS-DEV] 3.0.0-betat1 database upgrade and reingest
> 
> I'm curious to know what options you used when you ran pingest.pl and if it is actually a "stock" version of pingest.pl. That above error should not happen with the call on line 272. It deliberately skips doing the browse ingest.
> 
> That said, I have not run pingest on a 3.0 database so something may have changed in the reingest_metabib_field_entries function that leads to this error.
> 
> pingest.pl doesn't use transactions, so only the failed records need to be run again.
> 
> pingest.pl splits the input into batches for the search, facets, and record attribute ingest which can be done in parallel. The browse ingest is done in one giant batch of all the records because of errors similar to the one you cite above when two batches try to update a record on the same authority.
> 
> Like I said, I'm curious what options you used and what has changed in Evergreen 3.0.
>

The options I used were pretty standard

./pingest.pl --batch-size 250 --max-child 4

I think it is the latest version, I did a git --fetch; git pull --ff-only 

Ah, I now see that I'm still pointing to git.mvlcstaff.org/jason/evergreen_utilities, but it looks like it is no longer hosted there.  When I look at https://github.com/Dyrcona/evergreen_utilities, I only see one newer commit that doesn't look like it changes pingest.pl.  The latest commit in my version is the July 9th 2016 update.

Josh