<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: "Calibri Light", "Helvetica Light", sans-serif; font-size: 16pt; color: rgb(0, 0, 0);" class="elementToProof">
Just want to say thank you to people for helping us out with the marc export (especially Josh Stompro was really helpful in getting our commands right and Jason Stephenson, I believe, updated the export to make it work better and pointed me to some good resources).</div>
<div style="font-family: "Calibri Light", "Helvetica Light", sans-serif; font-size: 16pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: "Calibri Light", "Helvetica Light", sans-serif; font-size: 16pt; color: rgb(0, 0, 0);" class="elementToProof">
We ran an export over the weekend that worked successfully without crashing the server. 1.4 million records, we did it in batches of 100k per file and it was roughly 40 min. or so per 100k records. Some of our bibs have A LOT of items attached, so I didn't
think this was crazy in timing.</div>
<div style="font-family: "Calibri Light", "Helvetica Light", sans-serif; font-size: 16pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: "Calibri Light", "Helvetica Light", sans-serif; font-size: 16pt; color: rgb(0, 0, 0);" class="elementToProof">
Thanks again - really appreciate the support of this community!</div>
<div style="font-family: "Calibri Light", "Helvetica Light", sans-serif; font-size: 16pt; color: rgb(0, 0, 0);" class="elementToProof">
Brian</div>
<div class="elementToProof">
<div style="font-family: "Calibri Light", "Helvetica Light", sans-serif; font-size: 16pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div>
<div class="WordSection1">
<p style="line-height:18.0pt"><span style="font-size: 12pt; font-family: Georgia, serif; color: rgb(51, 51, 51);">Brian Holda<br>
Library Technology Manager<br>
Hekman Library<br>
Calvin University<br style="box-sizing: border-box">
(616) 526-8673<o:p></o:p></span></p>
<p style="line-height:18.0pt"><span style="font-size: 12pt; font-family: Georgia, serif; color: rgb(51, 51, 51);"><a href="https://library.calvin.edu/"><!--[if gte vml 1]><v:shapetype id="_x0000_t75"
coordsize="21600,21600" o:spt="75" o:preferrelative="t" path="m@4@5l@4@11@9@11@9@5xe"
filled="f" stroked="f">
<v:stroke joinstyle="miter"/>
<v:formulas>
<v:f eqn="if lineDrawn pixelLineWidth 0"/>
<v:f eqn="sum @0 1 0"/>
<v:f eqn="sum 0 0 @1"/>
<v:f eqn="prod @2 1 2"/>
<v:f eqn="prod @3 21600 pixelWidth"/>
<v:f eqn="prod @3 21600 pixelHeight"/>
<v:f eqn="sum @0 0 1"/>
<v:f eqn="prod @6 1 2"/>
<v:f eqn="prod @7 21600 pixelWidth"/>
<v:f eqn="sum @8 21600 0"/>
<v:f eqn="prod @7 21600 pixelHeight"/>
<v:f eqn="sum @10 21600 0"/>
</v:formulas>
<v:path o:extrusionok="f" gradientshapeok="t" o:connecttype="rect"/>
<o:lock v:ext="edit" aspectratio="t"/>
</v:shapetype><v:shape id="_x0000_i1027" type="#_x0000_t75" style='width:183.6pt;
height:25.2pt'>
<v:imagedata src="data:image/png;base64, iVBORw0KGgoAAAANSUhEUgAAAYQAAAA0CAYAAACKAE8SAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAAuIwAALiMBeKU/dgAAABx0RVh0U29mdHdhcmUAQWRvYmUgRmlyZXdvcmtzIENTNui8sowAAAAWdEVYdENyZWF0aW9uIFRpbWUAMDkvMTgvMThkURqfAAAV70lEQVR4nO1dz48cx3X+qmd26ThwuILMQ4wAXOZA5MYVkksu4Qj5hSAxtAJo65CRuTQgGLGNaIWREWtiiMNEGQR2RlyecsiBs8LAceIkXgFWAkMHDS/OUcv8A57VyZYVc5eGERvmbuVQr7pfVVdVd8/07AyX9S16u7u6fk139fvqvVdVLd599100Go3cliRJutebEAJJkgAAhBCXV+SHLzblR38pcPJr48/dBiABqJ2kYylZmJRIr0gJyOxYx5NThEtWTiIE/ucPfk88evQIx8fHePToEezjac7tsIcPHyIiIiLiLKHJBb5NBjYhECl8qiGP/qR58qMvC/mLDZWNgBACgJLzEBICAlICQpCwFoAAIKWAgISEoCpIgB0LCEiRZpSlp3JS0tFQEfSOgkRus8PLnIfCIiIiIs4ampwMbGKwNIXVBv7vjxonP/qCOH74Z7mchPqXiuxUSDOhLogMNFEAEBKQKVnAlPnGsTpR8UkgS04OWeR5kYAdFhEREXGW0LQ1AHsjYvjtleNJR5z89DkB+XE4hKKmAikAIbNevu65a70AHs1A55IK9TS+fSUP+1oVoQ9HujJhEREREWcNTe0X0HuLCD61Kn/4auOXDz4Hefx0XhAyUUxdfgFACmmSAgSkkCkHGNoASEuA0AdmfA90yT6imKXn79MGooYQERFxltHkZMBI4ROr+MnnV05+8kUhf3kZ4L1iFyloPtBmHZGRAmAKeqYZGDpAxgeWlC/hR9BXBOUzpXD3CfxIBBEREU8CmlxgJkmyei45/PTHkp92Evzid7POv0UGtmwkKS6EhJREClC+AX3d3+sPmY0oD8tVkMuGe5TToGrCfda4EREREY87UkI41/jZ7/zqys++tiJ+/oeA/HjW83eRgTA4QQruQKYRRMqzjJQeLHOQbTaCBH7/m69mJ5Re6nOoBN/77Nezgh1EYNa5OLyq0H+SyKDdHayP+p3JousRcfYQ29Zyogng6bWPfXTrV1Z+fkOIjAiccJBBFqI1BFeigDOAZ10FTjLwC/E6hP5ZJoN2d7AGYANAi+33aR8RMTWobbWQtaurAHYBbC2sUhFONH/9Ex98v9loXjaD3X4C31HmTdbh0m3aKUkOdaIuoX9WyaDdHawDGAO4uNiaRDxuYJ2Iiau33+4ONgDswd22cvEjFo9mAnm5OJqNsHD0WHK8OZ0uRVQHJ4M/fumrPQA3SyS7N+p3WkWR2t1B2Z//7KjfGZeMWxqjfmfS7g5aADZpu1p3GRGniwpt6tao3+lNWcYGVEfiPJ3n8hr1O/vt7mATSivYRux0LD2S6ZKF21tZMijOaTkg2Q/63j/9fQ/AMwDuADhwRN8F8HwZMiA8BeAGgHuOawcAXgFwaR5koDHqdyajfmcHQG9eZUScKnSbettx7QCq7T4zLRkQeiAyIDg7SaN+Z5/a1nCGsiJOCc2/+fcf49zqKtnZAUBYx8BXPv00tFYgjSMGaR04pxGcvviXHnaaJfydf3xj/8GDB9vt7mAM4Dss2v1Rv7NVpX6jfucQ6mUZOnp2W/MkgoizCatN7QO4wi5vj/qdvRqKWashj4glg0dDkNaen8qcWKfl5TyaQTkSqEwVzsL8wtwl6Gsgi8OC85kQySCiBsyrjY6t8zs15RuxQKSEIIF0iKdaPZTCHT1/FSf7UyuZUniamA8YlSw5j28UHIZT/s/e+6+LLCIiniSQuel5ALcA3Bj1O9sFSfbnXqmImdHMxJtkq8yB+Y2VwBSCXfBoApoU0v9M2EtGCnY6v/nJHT13uaKgL0sAVckiIuJJApmeypqfatWeI+aDBDCFdaYlmCYgmevSm+epZiCZFqDjcVLgaXhN8lLeCvKYsXgMXRyruBbqthAvGxYKj4iIiDhLSLh8NXrxJNDdpJClYBehiSQjBWaE4vla3CKNvAJlOEJ9YtpFBLOE8fCIiIiIs4gmgOyjNukKpYCgDxVIkReKLqT9eZsMPNpB/rgYXuFvn1sCPST0XenKhEVEREScNTTTI+03kFJ9gIaRQiZyAxPSyGlg+BHSMM0KmcaRmncouqE15MxJhqeDTFN+TSJEBlXIoozWsEywlgjgGC/TiCWaCNfi4+A9dZ8A2KNhlN58rOC9Ub9T2YFJM7Y3UNO9o4lbLarPxBHOh21OVedlAH9us8xrcDzLQ6h7X+m+sPqsjfqdoXWN33vvc6W6bMB8RhNKMznt+pwmmloaS/1FMog8KaQI2e9Zb19mIt38prI6yExEPr9EcXmsYL5Ly7Q3O7zMeShsmUCNbgfAdU+Um+3u4AhAjyYJzVreFoC7gSi7ej4GNXq9tWCOie9R3bdpO488dtrdwTZ/mdrdQQ9qHZyLjvg3293BPajx9kFhQiSwFchL53eAwJwQi0xaMGd77wOY0D3bhvn7eRn3qYylJgYmLPWmf88BKk5sLPHsUfQsrfq0kD3He1DzMHQZWzCf8djKZ5PiPFdQ5ztQ71GokzJNfQ7b3cEePPeBcDDqd9YdZQ7hf/dv2EQUQmKIeybIIdnwU2eP3IZMhX42tJSTAScM7WeAoTVkQ5PMbLNLeW+Dq1YuQghtdhrXuS9s0SCBO0HWIG5BzUIVyGasHkE1tNvUeGYCNbCnoGZla/BZ1VssfBOKrF6GJQzpJZxAzXL1vQjnAdxtdwdb7e5ggyZa3UR4GYSrAMb08jlB135QIi/Q9feovi5sQP3Gm8gv/aHrfBduMtC4QnVeL6jLorEN4DZUe+O/Z1IxnxaKnz2g7uf7RKhF9TGeI3UcdBn2M95n8XagJpgGyYDwMvJzMOqoz3DU76xBDeW9b127D/VOr7sKpPftErL38YjyeaoKGQDahwD1rWIIkfkTUk2BxQ4IwtbuK7kwTi7F4dIU/j63cYCc0hQVCaDstSUlgzGyF8roDegZqySQ3qfg6+3uYL8GTWETjIR85gIK71Fd37cuD6EEaWoyIUGtSYQLCl3ffSiSS01JlPc2zF7SeUqz5anXYbs7eAXqBd23TQEk/Hswhd6Qlm02eod6+CUJ8z0rzW2oF7UHZRYoU2cf8Swco35nEwDa3YEWfNNiHdk94cJ5A+qZvWzFv9vuDia2lhaoz1VWxj4UaevrR9YzHCJrB0b+TIu8yYKvtLuDnqvNz1qfUb+z1+4ODgG8x9KuF2mOtCaZNnf2pp2N3kxNOQIQUmakAElh6rtm+UWv/ZBmt95zzUUG7qGoXqMVE+BmcDUNYRrtwYOrFRYWqwNDZEJz19cboEXG7iMTVD1kArYyLJNRKZWU6nAAs2fkEq6axPagXlL9+86DmaLsvAFsEfHxl/A6Akssh0iRXswx1Mur63weSlgPPWkmjqUinne9nKzOY5jmt+fa3cGazySxRNjDbIQwdN1/ui/bpMmOYXYKhlBC1ZmfVZ/7o35ng52PSWBehzVJjsp0ClzqKPRISPP8txA2kc1Sn7H1rpxvdwebISFPxHUFSjsYBuoVRDZTWeoho9IwF/FhpPyPI3ctszXl4lFhRmieOBzagTTT2rkbxyS8T05OCo+nNSV5cARlK5x2Kw1SPw17fEES3pjOB8wfReVuQQmwI1S0T8IyK4SEHluPhyMoJEnAGAsOkk13KlAdelZwUX4T67yozkPkTQQbjqhLhXl/3IaEtN1GL/pMR4625LrvPdqPp6iP3bYuhsx7NdSnZ51vherHrnsHYZRBU8luNRNZm4sAkdcWJMC/mmaQgqtbDzMsDbWFaUE2NqVkhy6Tkqr7NMJ/Gs3Bgf0Kq5zmUFG72GLH96d4QVsoP8sUQI4MWqfgAN2DaTooIyh5j74O2L9xvca8NcYwyd3r+3iSQD3lezD9Ml4NrUR+E9KUJ1NWyW5b6zPkVVSfPZhm0yLNcYv2vWnrAwBJarGXMjcSSObs9dQvl9bmHSWktQd94vAHpLF4GXyfT8dL4pe4D8FFClXJgcfX+S6DH4FUTd4wpxHMlXqhpJGcJhlMi1rrdUq/037Jl15DOEXYnZbWLJmN+p2Nqo5Whtrbgq8+Hg15y5UHafsXob7BMpmlPk09AkgI8hVIkTp1hW/ZokLYvgBHLiEyYGYhpyZghaX/lYIQJADXtTIahR2+YLTsc7JFh7A+bWHWsLbC4ZwRETXCbmuhEUlnDTswNeRtuH1/2rQ260CRbGKaJBORFqwCAi6RbbqWs0lrThHpFJySRS4gA3fqsHYAOAV/iBxqNBmdFmyTwkXM6WtUpBlcZ0E77e6g8gSdZYY1KW4D2f3dwJMlgJYOZDYywtrdQWtek7jYZLF1ZJraGsJDhucCMilxk9nFdnewYY3KWoN6Pw/q+M5FU/t/hZ6lDKTagiaGVPIKYQnqUM/fhXJkkM+L7QPagb7iI4OQdlBVY1gyTP0pxBLYgzlx6DzUEMvWYzASJgjP0E+N+8h6p1cd1yPOEGiY6DbyHasjqHZwD4ok5tLxCmAHZvvbhmk60sfDOgprplZ+chqr7yFnBBCy5XP83X/8r2P0kZmG+yf0Pykzod679klHOlMN4NqBoRWwuCcnJ87NJoAyRBHyKTwJoOGiLZhzCK4gMMb/cYBjtvU9qJfK0H5oJMkPTrFqEQWoUzugHvYYmQagh23uOeYkDOGfETwX0PBnPgR103Iub9N+ZnMRoFc7ZULZ8CNXEH7aeaxNNtwhLclPISl/sGOdShcT8htowjHrpCufMUQZAiijPYTIYckwVyckqag3rODr1Kt67EAEx8ng7VG/0xr1O0OHKWz9tOq1rGATnhZR9vqci9iDaQ5qjfqdbQ/pzLsuPgzZsZ4Lo9vxRaj5ObVo6wmJYxL+poBOZbpMRT181n1pJABLn5ZgaAVIy7I1h3JkYBCYlYILfRcRlDUphchhwZhY5615F0gjIXat4NuzjPNfIGwiq0Js4xrrsfQggWzPMD9NrFvnlebrhEBEx80xu1UGTJziYnRD61y31y3az+w70FAT07TwtohBcgIwOEHmNvNUk4BMo5tagS4rI5KMeJCVSccSZnA+VqZhAPASQRUSKDInLRhj63zqiWZVQLOE7UlUe6fQi6sbxpo1Z8lBPgf0Fly+3a5rE36OvCc15l0bqH3yztgV6ohdR03OZI0kE9xaQGfEkPlwbQ3BvbGcMgHPiYBpIFpD4D18BYsMDHNQ3lTEg/VVnw9hWg3BRQqLBDUQu6ekVw6dNzah7Kwa2skcJ1OdMRDRX19wNbjQnmlZhsccQ+t8z9rXgiQzC7E+PevpG76B0GZpDgYJ2ESQmmB0NbSQDZNBFsN0RvNwIE8ILhPSLOSwJOhZ53q1zLkKZiKjLUfZtTi1Tgmc0HAa2tVjih7tj0KR5gUa8nyRBXmXnZ4Sdl5L2w7IPMWXztCj/mp978hkxB2+Zl/frSHkoQW8TQKmtmGajdKyDXMRC7PIINVEpEkMSK8pHB8fFwp/H1GUIYXTQsiZRw3kjhV8BWrt/d48HYGkotplP05OZrtXNQz4Qtatc1+8MwU2vh2YwwzdEuVvwVxhdLeOb3lYsNvBlXZ3MHR1qihszQpr1VyfIti/f5ola4IQL/71m1IINd1MpP+QrW4qgN61CwC75kLv2z82AwwzDjPvsAhatmoh+7cvXEjJKUssjTzeufb1HBlw5/S5ZhP/9Vu/KY6Pj6G3R48ewXfuOi4KA7xj2I+gPnJSdY2gNahet7165B0AO6GHTmu520sFc9impXWoXpcxd4F9uIO/hAdQX8LK9coovmvdoFdcL65jqW4AeDbkmHMsIeytD6vTHixHIdTs6kMWb53qbk86uw+z16hJ1Y53A46vZ1G+Q6v8wjkitLIr92u8TXWeuFMUg022G8Ksv/0bfeCTse7Za3Q5nk1wSRPPMN8e1Ppfh1adt2HewzujfifY2XDkX+pd9Lw/eu6Bhr4X+rsixm9wteFp61NQ1zUAD1iQ812bBeLF7kARAmcDmKe3PnOhMKPetz8CYDp69c5HBEr460OJN164ECQDQOK7174BTjAmOUisNpv4z8uXZiIEFxHo/Z+/9g+bUExtC0KOIyhB3iu6bw5h4MJ9AJs+AUE9lWFBnTQOoBrxkNKuUdpQHZzlU7nvecoYjvqdHqn9fGKbNy7LtyiN8XUxjyC2cY/STCjNBhR5hO7ZLtVjCPf9uUW/sahNHEERiGGSKPHsg8/dh5JtqgpSQiiRt7Ptk4DsodrELq/AZfmW+a1Bgi3RqTqAagcTuEdcHYGWcq+jPiFYcyEu1a0hNJUclUgXqyAmcDlr1RU3JJP8TqMKE/7GMTINQRokklJFRg7MjGSQgZnaMAGFzEdV5yhQPfdRbkJWWVtnD+XsgN786IVZJyG3ibxZ4xCqd577Ri014p0SdciVT8sKPAP36pw6/h6Kh2raeVdNc4hyo2HSNHQf1klQbcL8DWMokpoAhjDbQHYv+beSy7YJG1Pd95ryrQJeh2nbyhD0gSGYn+C0284E6n6W/Z5y2d8aen+26R3YRv6b3uOR+fnWZ5G1NV1P3uufuT4FGEMRQu3mIgAQfMllxQW2+Ujg1mc+SRH8NqOb/2qZjBxmItv+LjObESSAN164QCmZr8Iig3eufSNPBppgJHBupYm3L/2GoSHY27Qaw6JHF0VERDzZaHcHEygtq9CMNg3UJzSlXu0UpnOXLV6H3DULaS8/H26H2UTArlgmIgpj6sqf/turxjm4diGB5so5fOfVkVcjKNIYQtpDRERExKJAmqo2uU3tiwihmZpraK8dzCY5FAtD6SMER5wyJiN9YC9TESID+gFeIihDBr4hqhERERELRqoRzGuWdKohADl9ICWHMnARQa5XbWsEMm/y4blVIYOk0YBIVj4QInndZSaaRWOI2kFERMQiQQM40lFf8yqnmU4asExGnBy+9q0Pp8vdYS5SwT6TEZAT/OAaQJ4MhEiQNFc/SJLk9c9v392tYhIqGzciIiJiwRiy4/G8Ckm/qayhHct5f0JwGgKAAsNSYJRRdl5kImLHQqCRrD5MGo03X+q8dYtrAiGHcpHWYIdHRERELBI054MP1x3PqyxlMgK8DmM+8qiS4cQr9B1hUq9/FNIK6J8QEKLxsNFceRPAzkudt458ZFBWUwhpDBERERGLAg3T7fGwea6ympmMgKDZqDI85iJjNFJJk5FOkzSaSBorOwB6X/jK6Mh2FttEUFYj8F2PiIiIWBTIb7CD/EzzuSEzGalPpWVmIf65zFmdqhYJpMfsuppb4NYKkkYTEI23kiR5/S/+6psHttD3EYMt5Ks4m6MjOSIiYhEgE9EW3N9xHs6z7HImIyMg4EmwJ55Z4TYJ5Mq2FrgTSQMSje8mjcaXv/jVfz5wmXZ8hFBGA4iO5IiIiCXEBGqegT3XYK/KB3ymgdtkBEynFfgIwXE9py0wUhAiwTEa/73aXHntS699617I1m+TQBUTkm+LiIiIWBRoKYy5TDwrQlM5afXKpuFxRIWzEjihuOKTWco+145rAQE0Vj5sNBqffbn7LzkiKEsIZU1IUTOIiIiIyPD/uINL9MYWz0MAAAAASUVORK5CYII=" o:title="hekman_header"/>
</v:shape><![endif]--><!--[if !vml]--><img border="0" width="245" height="34" v:shapes="_x0000_i1027" data-outlook-trace="F:1|T:1" src="cid:061f7729-20eb-4246-89ab-42e69fe89b31"><!--[endif]--></a><o:p></o:p></span></p>
<p style="line-height:18.0pt"><span style="font-size: 12pt; font-family: Georgia, serif; color: rgb(51, 51, 51);"><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Brian Holda <brian.holda@calvin.edu><br>
<b>Sent:</b> Monday, October 9, 2023 8:56 AM<br>
<b>To:</b> Evergreen Development Discussion List <evergreen-dev@list.evergreen-ils.org>; Brian Holda <brian.holda@calvin.edu><br>
<b>Subject:</b> Re: marc_export - apache crashes</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div class="x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
Or maybe a better way to ask this. Have people found a good way to export a large number of marc records within Evergreen? We found the staff client way to do it. And it processes files of 5-10,000 records at a time. But if we want to do 1 million records,
let's say, it's a bit tedious. So then I found the <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.evergreen-2Dils.org_3.2_-5Fmarc-5Fexport-5Fexporting-5Fbibliographic-5Frecords-5Finto-5Fmarc-5Ffiles.html&d=DwMGaQ&c=4rZ6NPIETe-LE5i2KBR4rw&r=rB3XDC6iCWGkjZtiGXbRHlEfGQP12yvXoVpChsQG6IY&m=PZmft0gaDkWQJ-PsQAmuzLbFyoxYjph24cGK4vqaTEXFnORZ9vEDMUnFRbuzb4np&s=28sCuznEp6eX3W0zi51ryW-NBwTZ0P8RjE4l6oEL_rE&e=" data-auth="NotApplicable" title="https://docs.evergreen-ils.org/3.2/_marc_export_exporting_bibliographic_records_into_marc_files.html" id="OWA3234c12f-45d0-ad35-68af-7fb1dd29f67b" class="x_x_OWAAutoLink x_ContentPasted0" data-ogsc="" data-linkindex="0" style="margin:0px; background-color:rgb(255,255,255)">marc_export
script</a>. But that crashed our server doing it with 3,000 records at a time. We have ideas on how to modify the process, and it's not terrible using the staff client way, but I figure this must be a somewhat common task that others have good solutions for?
Anyone willing to share <span id="x_🙂">🙂?</span></div>
<div class="x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
<span><br>
</span></div>
<div class="x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
<span>Thanks,</span></div>
<div class="x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
Brian</div>
<div class="x_elementToProof">
<div style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
<br>
</div>
<div id="x_Signature">
<div>
<div class="x_WordSection1">
<p style="line-height:18.0pt"><span style="font-size:12pt; font-family:Georgia,serif; color:rgb(51,51,51)">Brian Holda<br>
Library Technology Manager<br>
Hekman Library<br>
Calvin University<br style="box-sizing:border-box">
(616) 526-8673</span></p>
<p style="line-height:18.0pt"><span style="font-size:12pt; font-family:Georgia,serif; color:rgb(51,51,51)"><a href="https://library.calvin.edu/"><img border="0" width="245" height="34" data-outlook-trace="F:2|T:2" src="cid:e83c175b-fa22-41ee-b0e4-dc4102c98d50"></a></span></p>
<p style="line-height:18.0pt"><span style="font-size:12pt; font-family:Georgia,serif; color:rgb(51,51,51)"> </span></p>
</div>
</div>
</div>
</div>
<div id="x_appendonsend"></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Evergreen-dev <evergreen-dev-bounces@list.evergreen-ils.org> on behalf of Brian Holda via Evergreen-dev <evergreen-dev@list.evergreen-ils.org><br>
<b>Sent:</b> Thursday, October 5, 2023 4:25 PM<br>
<b>To:</b> Evergreen Development Discussion List <evergreen-dev@list.evergreen-ils.org><br>
<b>Subject:</b> [Evergreen-dev] marc_export - apache crashes</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div class="x_x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
Hi all, </div>
<div class="x_x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
Not sure if it's user error or something else going on, so wanted to see if any of you all have experience using
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.evergreen-2Dils.org_3.2_-5Fmarc-5Fexport-5Fexporting-5Fbibliographic-5Frecords-5Finto-5Fmarc-5Ffiles.html&d=DwMGaQ&c=4rZ6NPIETe-LE5i2KBR4rw&r=rB3XDC6iCWGkjZtiGXbRHlEfGQP12yvXoVpChsQG6IY&m=PZmft0gaDkWQJ-PsQAmuzLbFyoxYjph24cGK4vqaTEXFnORZ9vEDMUnFRbuzb4np&s=28sCuznEp6eX3W0zi51ryW-NBwTZ0P8RjE4l6oEL_rE&e=" title="https://docs.evergreen-ils.org/3.2/_marc_export_exporting_bibliographic_records_into_marc_files.html" id="LPlnk706936" class="x_x_OWAAutoLink">
marc_export script</a> and had similar problems.</div>
<div class="x_x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_elementToProof" style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
In brief:</div>
<div class="x_x_elementToProof" style="font-size:16pt; color:rgb(0,0,0)">
<ul data-editing-info="{"orderedStyleType":1,"unorderedStyleType":1}" style="">
<li style="font-family:"Calibri Light","Helvetica Light",sans-serif; list-style-type:disc">
Tue, 5pm - I ran the following test (this is for a file of 3,100 records). This took about 30 sec. and successfully created the export file without any noticeable effects on our apache2 server: <br>
<span><span class="x_x_ui-provider x_x_ec x_x_bls x_x_bcg x_x_blt x_x_blu x_x_blv x_x_blw x_x_blx x_x_bly x_x_blz x_x_bma x_x_bmb x_x_bmc x_x_bmd x_x_bme x_x_bmf x_x_bmg x_x_bmh x_x_bmi x_x_bmj x_x_bmk x_x_bml x_x_bmm x_x_bmn x_x_bmo x_x_bmp x_x_bmq x_x_bmr x_x_bms x_x_bmt x_x_bmu x_x_bmv x_x_bmw x_x_bmx x_x_bmy" dir="ltr"><code class="x_x_ContentPasted0">cat
/home/opensrf/marc-test.txt | marc_export --reporter -i -c /openils/conf/opensrf_core.xml -x /openils/conf/fm_IDL.xml -f XML --timeout 5 > exported_files.xml</code></span></span><br>
</li><li class="x_x_ContentPasted2" style="font-family:"Calibri Light","Helvetica Light",sans-serif; list-style-type:disc">
<div>Wed, 11:40am- I ran what I thought was essentially the same test (for the same file of 3,100 records). This also took about 30 sec. and successfully created the export file. However, 8 min. later apache crashed and had to be restarted. In the error log,
it said <span><span class="x_x_ui-provider x_x_ec x_x_bls x_x_bcg x_x_blt x_x_blu x_x_blv x_x_blw x_x_blx x_x_bly x_x_blz x_x_bma x_x_bmb x_x_bmc x_x_bmd x_x_bme x_x_bmf x_x_bmg x_x_bmh x_x_bmi x_x_bmj x_x_bmk x_x_bml x_x_bmm x_x_bmn x_x_bmo x_x_bmp x_x_bmq x_x_bmr x_x_bms x_x_bmt x_x_bmu x_x_bmv x_x_bmw x_x_bmx x_x_bmy x_x_ContentPasted1" dir="ltr">"couldn't
grab the accept mutex" immediately before crashing. Here's the code I ran:<br>
</span></span></div>
<div>cat /tmp/marc-output/marc1.txt | marc_export --reporter -i -c /openils/conf/opensrf_core.xml -x /openils/conf/fm_IDL.xml -f XML --timeout 5 > /tmp/marc-output/exported-marc1.xml<span><span class="x_x_ui-provider x_x_ec x_x_bls x_x_bcg x_x_blt x_x_blu x_x_blv x_x_blw x_x_blx x_x_bly x_x_blz x_x_bma x_x_bmb x_x_bmc x_x_bmd x_x_bme x_x_bmf x_x_bmg x_x_bmh x_x_bmi x_x_bmj x_x_bmk x_x_bml x_x_bmm x_x_bmn x_x_bmo x_x_bmp x_x_bmq x_x_bmr x_x_bms x_x_bmt x_x_bmu x_x_bmv x_x_bmw x_x_bmx x_x_bmy x_x_ContentPasted1" dir="ltr"><br>
</span></span></div>
</li><li style="font-family:"Calibri Light","Helvetica Light",sans-serif; list-style-type:disc">
<div><span><span class="x_x_ui-provider x_x_ec x_x_bls x_x_bcg x_x_blt x_x_blu x_x_blv x_x_blw x_x_blx x_x_bly x_x_blz x_x_bma x_x_bmb x_x_bmc x_x_bmd x_x_bme x_x_bmf x_x_bmg x_x_bmh x_x_bmi x_x_bmj x_x_bmk x_x_bml x_x_bmm x_x_bmn x_x_bmo x_x_bmp x_x_bmq x_x_bmr x_x_bms x_x_bmt x_x_bmu x_x_bmv x_x_bmw x_x_bmx x_x_bmy x_x_ContentPasted1" dir="ltr">Wed,
4pm- I ran essentially the same command <span class="x_x_ContentPasted4" style="display:inline!important; color:rgb(0,0,0); background-color:rgb(255,255,255)">
(for the same file of 3,100 records)</span>, but without using the <code>tmp</code>​ folder. This time it stalled and after waiting a few minutes we pressed
<code>ctrl</code>​ + <code>c</code>​ which I assumed stopped everything cleanly, as it returned me to the command prompt. However, at 4:50pm apache quit again, with the same "couldn't grab the accept mutex" messages beforehand. Here's the code I ran this time:<br>
</span></span></div>
<div><span><span class="x_x_ui-provider x_x_ec x_x_bls x_x_bcg x_x_blt x_x_blu x_x_blv x_x_blw x_x_blx x_x_bly x_x_blz x_x_bma x_x_bmb x_x_bmc x_x_bmd x_x_bme x_x_bmf x_x_bmg x_x_bmh x_x_bmi x_x_bmj x_x_bmk x_x_bml x_x_bmm x_x_bmn x_x_bmo x_x_bmp x_x_bmq x_x_bmr x_x_bms x_x_bmt x_x_bmu x_x_bmv x_x_bmw x_x_bmx x_x_bmy x_x_ContentPasted1" dir="ltr"><span><span class="x_x_ui-provider x_x_ec x_x_bls x_x_bcg x_x_blt x_x_blu x_x_blv x_x_blw x_x_blx x_x_bly x_x_blz x_x_bma x_x_bmb x_x_bmc x_x_bmd x_x_bme x_x_bmf x_x_bmg x_x_bmh x_x_bmi x_x_bmj x_x_bmk x_x_bml x_x_bmm x_x_bmn x_x_bmo x_x_bmp x_x_bmq x_x_bmr x_x_bms x_x_bmt x_x_bmu x_x_bmv x_x_bmw x_x_bmx x_x_bmy" dir="ltr"><code class="x_x_ContentPasted3">cat
/home/opensrf/marc2.txt | marc_export --reporter -i -c /openils/conf/opensrf_core.xml \ -x /openils/conf/fm_IDL.xml -f XML --timeout 5 > /home/opensrf/exported-marc2.xml</code></span></span></span></span></div>
</li></ul>
</div>
<div class="x_x_elementToProof">
<div style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
Anyone know what might be happening here?</div>
<div style="font-family:"Calibri Light","Helvetica Light",sans-serif; font-size:16pt; color:rgb(0,0,0)">
<br>
</div>
<div id="x_x_Signature">
<div>
<div class="x_x_WordSection1">
<p style="line-height:18.0pt"><span style="font-size:12pt; font-family:Georgia,serif; color:rgb(51,51,51)">Brian Holda<br>
Library Technology Manager<br>
Hekman Library<br>
Calvin University<br style="box-sizing:border-box">
(616) 526-8673</span></p>
<p style="line-height:18.0pt"><span style="font-size:12pt; font-family:Georgia,serif; color:rgb(51,51,51)"><a href="https://library.calvin.edu/" id="OWAcac8ab35-40d3-103d-afc4-c3e8fd0d7764" class="x_x_OWAAutoLink"><img border="0" width="245" height="34" data-outlook-trace="F:3|T:3" src="cid:4e579103-9d9b-445c-a644-73d36151b8e7"></a></span></p>
<p style="line-height:18.0pt"><span style="font-size:12pt; font-family:Georgia,serif; color:rgb(51,51,51)"> </span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>