[Evergreen-catalogers] Batch deleting MARCs

[Blake Graham-Henderson]

Tricia,

You might be interested in this external program we developed to keep 
Evergreen's electronic bibs in sync with an external vendor such as 
Hoopla. (including removals). We ended up developing it to solve this 
exact problem. There's a LP report for inclusion of this script but it 
needs more work before it can be included in Evergreen:

https://bugs.launchpad.net/evergreen/+bug/1947898

I presented it for the Evergreen conference 2023:

https://slides.mobiusconsortium.org/blake/bib_magic/#/

Presentation recording:
https://www.youtube.com/watch?v=yGEypjsRMxA

NC Cardinal presented at the 2024 conference showing how their using 
that tool in conjunction with other methods to prune and shape the 
Evergreen database. I can't seem to find the slides or a recording of 
that, but it's called "Modify a Million MARC a Month"

https://evergreen-ils.org/conference/2024-evergreen-international-online-conference/2024-program-descriptions/

I'd be happy to answer any questions.

-Blake-
Conducting Magic
Will consume any data format
MOBIUS



On 10/23/2024 2:20 PM, Garry Collum via Evergreen-catalogers wrote:
> Just like Ruth, we have also gone to a discovery layer, but ours pulls 
> everything from Hoopla through an API, except music records, so it's 
> much less work than it used to be.
>
> The monthly deletions spreadsheet from Hoopla contains a list of 
> urls.  I use a text editor to format these urls into a SQL statement 
> so I can get a list of the record ids from our system.
>
> Something like this:
>
> select distinct(record)
> from asset.call_number
> join asset.uri_call_number_map ucnm on ucnm.call_number = call_number.id
> join asset.uri on uri.id = ucnm.uri
> where (
>  uri.href = 'https://www.hoopladigital.com/title/11780681' or
>  uri.href = 'https://www.hoopladigital.com/title/12326359' or
>  uri.href = 'https://www.hoopladigital.com/title/16968789'
> )
>
> Once I have this list, I export the records from Evergreen and remove 
> the 856s using marcedit.  I then reimport them and send the records to 
> a bucket so they can be deleted.
>
> Garry
> ------------------------------------------------------------------------
> *From:* Evergreen-catalogers 
> <evergreen-catalogers-bounces at list.evergreen-ils.org> on behalf of 
> Tricia Everaert via Evergreen-catalogers 
> <evergreen-catalogers at list.evergreen-ils.org>
> *Sent:* Wednesday, October 23, 2024 12:47 PM
> *To:* Evergreen Community Catalogers 
> <evergreen-catalogers at list.evergreen-ils.org>
> *Cc:* Tricia Everaert <teveraert at nflibrary.ca>
> *Subject:* [Evergreen-catalogers] Batch deleting MARCs
> Hello cataloguing friends!
> We're looking at including Hoopla and possibly other digital records 
> in our catalogue, but don't want to do so until we find a way to batch 
> delete or automate the deletion of records for titles we no longer 
> have access to.
> We currently have cloudLibrary MARCs in our database, and then every 
> month we have to manually search and delete records for titles we no 
> longer have by first deleting an 856 field, then delete the bib.  
> Given the quantity of records we'd have from Hoopla, this workflow 
> wouldn't be feasible.
> My question is, how do you handle the maintenance of your digital 
> records, and is there a way to batch delete bibs from either mrc. or 
> csv files?
>
> Appreciate your thoughts,
> Tricia
>
>
>
> *Tricia Everaert*
> Collections and Digital Asset Technician
> Information Resources & Connections
> *Niagara Falls Public Library*
> 4848 Victoria Avenue, Niagara Falls, ON  L2E 4C5
> Tel 905-356-8080 x 251 teveraert at nflibrary.ca
>
>
> CONFIDENTIALITY NOTICE: This communication and any accompanying 
> document(s) are confidential and may be privileged. They are intended 
> for the sole use of the addressee. If you receive this transmission in 
> error, you are advised that any disclosure, copying, distribution, or 
> the taking of any action in reliance upon the communication is 
> strictly prohibited. If you have received this communication in error, 
> please immediately contact or inform the sender by return e-mail or by 
> telephone at 905-356-8080 x248 <tel:905-356-8080%20x248> and delete 
> this e-mail message and all copies. Due to the inherent risks 
> associated with the Internet, we assume no responsibility for 
> unauthorized interception of any Internet communication with you or 
> the transmission of computer viruses.
>
> The Niagara Falls Public Library promotes work-life balance and the 
> right for its employees to disconnect outside of work hours. Please do 
> not feel obligated to reply to this email outside of your normal 
> working hours.
>
> _______________________________________________
> Evergreen-catalogers mailing list
> Evergreen-catalogers at list.evergreen-ils.org
> http://list.evergreen-ils.org/cgi-bin/mailman/listinfo/evergreen-catalogers
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://list.evergreen-ils.org/pipermail/evergreen-catalogers/attachments/20241023/e44008e7/attachment.htm>