[OPEN-ILS-DEV] ***SPAM*** RE: Evergreen issues after secuirty upgrade in Karmic Koala

Soulliere, Robert robert.soulliere at mohawkcollege.ca
Mon Apr 19 15:09:58 EDT 2010


More error information (after expanding error logging):

osrfsys.log
srfsys.log:[2010-04-19 14:29:57] /usr/sbin/apache2 [ERR :1611:EX.pm:66:] Exception: OpenSRF::EX::Session 2010-04-19T14:29:57 OpenSRF::Transport /usr/local/share/perl/5.10.0/OpenSRF/Transport.pm:92 Session Error: router at private.localhost/opensrf.settings IS NOT CONNECTED TO THE NETWORK!!!

gateway.log
osrf_http_translator 2010-04-19 14:30:01 [ERR :1602:./osrf_http_translator.c:404:127170179716020] XMPP message resulted in error code 503
osrf_http_translator 2010-04-19 14:30:05 [ERR :1607:./osrf_http_translator.c:404:127170179716070] XMPP message resulted in error code 503
osrf_http_translator 2010-04-19 14:30:05 [INFO:1607:./osrf_http_translator.c:502:127170179716070] translator resulted in status 404

ejabberd processes (ps command): - anything look funny here?


ejabberd   952  0.0  0.0  10624   256 ?        S    14:24   0:00 /usr/lib/erlang/erts-5.7.2/bin/epmd -daemon

ejabberd   969  0.0  1.6 101280 17336 ?        Sl   14:24   0:01 /usr/lib/erlang/erts-5.7.2/bin/beam -K false -P 250000 -- -root /usr/lib/erlang -progname erl -- -home /var/lib/ejabberd -sname ejabberd -pa /usr/lib/ejabberd/ebin -s ejabberd -kernel inetrc "/etc/ejabberd/inetrc" -ejabberd config "/etc/ejabberd/ejabberd.cfg" log_path "/var/log/ejabberd/ejabberd.log" -sasl sasl_error_logger {file,"/var/log/ejabberd/sasl.log"} -mnesia dir "/var/lib/ejabberd" -smp disable -noshell -noshell -noinput

ejabberd   992  0.0  0.0  10624   316 ?        Ss   14:24   0:00 inet_gethost 4

ejabberd   993  0.0  0.0  12724   432 ?        S    14:24   0:00 inet_gethost 4

Based on the error information it is starting to look more and more like an ejabberd connection issue to me. Any ideas?

Thanks,
Robert


From: Soulliere, Robert
Sent: Monday, April 19, 2010 9:54 AM
To: 'Evergreen Development Discussion List'
Subject: Evergreen issues after secuirty upgrade in Karmic Koala


Hi Everyone,



Friday, I ran some system security upgrades in Karmic Koala on our test server and ran into some issues with Evergreen. Basically, I could not do searches in OPAC or slimpac, and I could not login to the staff client. The language options also didn't get loaded on the OPAC page.



System information:

OS: Ubuntu Karmic Koala

Apache: 2.2.12

Evergreen: 1.6.0 + booking

Postgresql: 8.3



I would also like to figure out the version of Ejabberd I am running. Does anyone know a command to get the current version if Ejabberd running on my system?



My guess is that the security upgrade broke a one of the communication layers and is related to Ejabberd or Apache2 and database connections. Could the upgrade have updated Ejabberd or an Apache module which is not compatible with Evergreen?



I have stopped and restarted Ejabberd, memcached, Evergreen and Apache.

I have checked for any unstopped processes us the ps command and removed any pid files before restarting

I tried rebooting the server.





If I try to connect via srfsh using the admin or my username, I get:



Received Data: {

  "ilsevent":1217,

  "textcode":"PATRON_INACTIVE",

  "desc":"This account is marked as inactive",

  "pid":28953,

  "stacktrace":"oils_auth.c:417"

}



even though the admin user and I are both active in the database.





This is a test server so not mission critical and I could reinstall the prerequisites evergreen on the server if needed, but I was hoping that I could solve this issue by fixing a broken piece of the puzzle without rebuilding or breaking the other pieces. Any tips would be greatly appreciated.







Below are log errors which might be the most helpful in troubleshooting this:



Thanks,

Robert







ERRORS from osrfsys.log





open-ils.cstore 2010-04-19 09:36:36 [ERR :28300:oils_cstore.c:4230:] open-ils.cstore: Error retrieving actor::user with query [SELECT  "au".active, "au".alert_message, "au".barred, "au".billing_address, "au".card, "au".claims_returned_count, "au".create_date, "au".credit_forward_balance, "au".day_phone, "au".dob, "au".email, "au".evening_phone, "au".expire_date, "au".family_name, "au".first_given_name, "au".home_ou, "au".id, "au".ident_type, "au".ident_type2, "au".ident_value, "au".ident_value2, "au".last_xact_id, "au".mailing_address, "au".master_account, "au".net_access_level, "au".other_phone, "au".passwd, "au".photo_url, "au".prefix, "au".profile, "au".second_given_name, "au".standing, "au".suffix, "au".super_user, "au".usrgroup, "au".usrname, "au".alias, "au".juvenile, "au".deleted FROM actor.usr AS "au" WHERE "au".usrname = 'admin';]



[2010-04-19 07:57:45] open-ils.fielder [ERR :7140:EX.pm:66:1271587436193450] Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T07:57:45 OpenILS::Utils::CStoreEditor /openils/lib/perl5/OpenILS/Utils/CStoreEditor.pm:384 <500>  Severe query error -- see error log for more details



open-ils.cstore 2010-04-19 07:58:12 [ERR :7131:oils_cstore.c:4189:1271587436193370] open-ils.cstore: Error with query [SELECT  "i18n_l".code AS "code", "i18n_l".marc_code AS "marc_code", oils_i18n_xlate('config.i18n_locale', 'i18n_l', 'name', 'code', "i18n_l".code::TEXT, 'en-CA') AS "name", oils_i18n_xlate('config.i18n_locale', 'i18n_l', 'description', 'code', "i18n_l".code::TEXT, 'en-CA') AS "description" FROM config.i18n_locale AS "i18n_l"  WHERE "i18n_l".code IS NOT NULL;]

[2010-04-19 07:58:12] open-ils.fielder [ERR :7155:CStoreEditor.pm:104:1271587436193370] editor[0|0] request error open-ils.cstore.json_query.atomic : {"from":"i18n_l","select":{"i18n_l":["code","marc_code","name","description"]},"where":{"code":{"!=":null}}} : Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T07:58:12 OpenILS::Utils::CStoreEditor /openils/lib/perl5/OpenILS/Utils/CStoreEditor.pm:371 <500>  Severe query error -- see error log for more details


[2010-04-19 08:08:27] open-ils.circ [ERR :28237:Circulate.pm:45:] Missing circ script(s)

[2010-04-19 08:08:50] /usr/sbin/apache2 [ERR :28360:AppSession.pm:101:] Attempting to build a client session as a server Session ID [1271678925.230475588.15330295212], remote_id [opensrf at private.localhost/opensrf.settings_drone_at_localhost_28217]

[2010-04-19 08:08:50] /usr/sbin/apache2 [ERR :28360:EX.pm:66:] Exception: OpenSRF::EX::Session 2010-04-19T08:08:50 OpenSRF::Transport /usr/local/share/perl/5.10.0/OpenSRF/Transport.pm:120 Session Error: Transport::handler(): No AppSession object returned from server_build()


[2010-04-19 08:08:51] /usr/sbin/apache2 [ERR :28368:AppSession.pm:101:] Attempting to build a client session as a server Session ID [1271678926.4716914341.2715950944], remote_id [opensrf at private.localhost/opensrf.settings_drone_at_localhost_28214]

[2010-04-19 08:08:51] /usr/sbin/apache2 [ERR :28368:EX.pm:66:] Exception: OpenSRF::EX::Session 2010-04-19T08:08:51 OpenSRF::Transport /usr/local/share/perl/5.10.0/OpenSRF/Transport.pm:120 Session Error: Transport::handler(): No AppSession object returned from server_build()



[2010-04-19 08:08:52] /usr/sbin/apache2 [ERR :28369:AppSession.pm:101:] Attempting to build a client session as a server Session ID [1271678926.642383707.04693932705], remote_id [opensrf at private.localhost/opensrf.settings_drone_at_localhost_28371]

[2010-04-19 08:08:52] /usr/sbin/apache2 [ERR :28369:EX.pm:66:] Exception: OpenSRF::EX::Session 2010-04-19T08:08:52 OpenSRF::Transport /usr/local/share/perl/5.10.0/OpenSRF/Transport.pm:120 Session Error: Transport::handler(): No AppSession object returned from server_build()



[2010-04-19 08:08:52] /usr/sbin/apache2 [ERR :28375:AppSession.pm:101:] Attempting to build a client session as a server Session ID [1271678927.9913918437.7467022227], remote_id [opensrf at private.localhost/opensrf.settings_drone_at_localhost_28215]

[2010-04-19 08:08:52] /usr/sbin/apache2 [ERR :28375:EX.pm:66:] Exception: OpenSRF::EX::Session 2010-04-19T08:08:52 OpenSRF::Transport /usr/local/share/perl/5.10.0/OpenSRF/Transport.pm:120 Session Error: Transport::handler(): No AppSession object returned from server_build()



[2010-04-19 08:09:07] open-ils.search [ERR :28332:EX.pm:66:1271678933283780] Exception: OpenSRF::EX::ERROR 2010-04-19T08:09:07 OpenSRF::AppRequest /usr/local/share/perl/5.10.0/OpenSRF/AppSession.pm:1012 System ERROR: Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T08:09:07 OpenSRF::AppRequest /usr/local/share/perl/5.10.0/OpenSRF/AppSession.pm:1012 <500>   *** Call to [open-ils.storage.biblio.multiclass.staged.search_fts.atomic] failed for session [1271678946.5842125744.8365919498], thread trace [1]:

DBD::Pg::st execute failed: server closed the connection unexpectedly

      This probably means the server terminated abnormally

      before or while processing the request. [for Statement "        SELECT  *

          FROM  search.staged_fts(

                    1::INT,

                    0::INT,

                    $${"keyword":{"fts_query":["to_tsquery('keyword','korea')"],"word":["korea"],"fts_rank":["rank(keyword.index_vector, to_tsquery('keyword','korea'))"],"phrase":[]}}$$::TEXT,

                    $${}$$::INT[],

                    $${}$$::INT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    NULL::TEXT,

                    NULL::TEXT,

                    NULL::TEXT,

                    $${""}$$::TEXT[],

                    $$en-CA$$::TEXT,

                    2::REAL,

                    $$$$::TEXT,




ERRORS from gateway.log


[ACT:28376:./osrf_http_translator.c:280:1271678933283760] [142.222.234.4] [] open-ils.fielder open-ils.fielder.i18n_l.atomic {"query":{"code":{"!=":null}}} osrf_json_gw 2010-04-19 08:09:06 [ACT:28378:./osrf_json_gateway.c:300:1271678933283780] [142.222.234.4] [] [en-CA] open-ils.search open-ils.search.biblio.multiclass.query {"org_unit":1,"depth":0,"limit":10,"offset":0,"visibility_limit":3000,"default_class":"keyword"}, "korea", 1 osrf_json_gw 2010-04-19 08:09:07 [ERR :28378:./osrf_json_gateway.c:342:1271678933283780] Gateway received error:  *** Call to [open-ils.search.biblio.multiclass.query] failed for session [1271678946.315846.127167894628378], thread trace [1]:

Exception: OpenSRF::EX::ERROR 2010-04-19T08:09:07 OpenSRF::Application /usr/local/share/perl/5.10.0/OpenSRF/Application.pm:202 System ERROR: Call to open-ils.storage for method open-ils.storage.biblio.multiclass.staged.search_fts.atomic

 failed with exception: Exception: OpenSRF::EX::ERROR 2010-04-19T08:09:07 OpenILS::Application::AppUtils /openils/lib/perl5/OpenILS/Application/AppUtils.pm:179 System ERROR: Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T08:09:07 OpenSRF::AppRequest /usr/local/share/perl/5.10.0/OpenSRF/AppSession.pm:1012 <500>   *** Call to [open-ils.storage.biblio.multiclass.staged.search_fts.atomic] failed for session [1271678946.5842125744.8365919498], thread trace [1]:

DBD::Pg::st execute failed: server closed the connection unexpectedly

      This probably means the server terminated abnormally

      before or while processing the request. [for Statement "        SELECT  *

          FROM  search.staged_fts(

                    1::INT,

                    0::INT,

                    $${"keyword":{"fts_query":["to_tsquery('keyword','korea')"],"word":["korea"],"fts_rank":["rank(keyword.index_vector, to_tsquery('keyword','korea'))"],"phrase":[]}}$$::TEXT,

                    $${}$$::INT[],

                    $${}$$::INT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    $${}$$::TEXT[],

                    NULL::TEXT,

                    NULL::TEXT,

                    NULL::TEXT,

                    $${""}$$::TEXT[],

                    $$en-CA$$::TEXT,

                    2::REAL,

                    $$$$::TEXT,

                    'f'::BOOL,

                    'f'::BOOL,

                    'f'::BOOL,

                    10000::INT,

                    1000::INT,

                    NULL::INT

                );

"] at /usr/share/perl5/DBIx/ContextualFetch.pm line 52.



 :



ERRORS from /var/log/apache2/error.log



[Mon Apr 19 08:54:58 2010] [warn] [client 142.222.234.4] incomplete redirection target of '/opac/en-CA/skin/default/xml/index.xml' for URI '/' modified to 'http://libdog.mohawkcollege.ca/opac/en-CA/skin/default/xml/index.xml'



[Mon Apr 19 08:54:59 2010] [error] [client 142.222.234.4] File does not exist: /openils/var/web/favicon.ico [Mon Apr 19 08:55:03 2010] [info] [client 142.222.234.4] OpenSRF JSON Request returned error: osrfMethodException ->  *** Call to [open-ils.search.biblio.multiclass.query] failed for session [1271681703.695147.127168170328374], thread trace [1]:\nCan't use an undefined value as an ARRAY reference at /openils/lib/perl5/OpenILS/Application/AppUtils.pm line 1280.\n\n, referer: http://libdog.mohawkcollege.ca/opac/en-CA/skin/default/xml/rresult.xml?rt=keyword&tp=keyword&t=fdf&l=1&d=0&f=

Use of uninitialized value $lang in string eq at /openils/lib/perl5/OpenILS/WWW/SuperCat.pm line 1025.

Use of uninitialized value $lang in string eq at /openils/lib/perl5/OpenILS/WWW/SuperCat.pm line 1070.



[Mon Apr 19 08:55:21 2010] [error] [client 142.222.234.4] Exception: OpenSRF::EX::ERROR 2010-04-19T08:55:21 main -e:0 System ERROR: Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T08:55:21 OpenSRF::AppRequest /usr/local/share/perl/5.10.0/OpenSRF/AppSession.pm:1012 <500>   *** Call to [open-ils.actor.org_unit_list.search] failed for session [1271678933.144222329.46480341782], thread trace [1]:\nException: OpenSRF::EX::ERROR 2010-04-19T08:55:21 OpenSRF::Application /usr/local/share/perl/5.10.0/OpenSRF/Application.pm:202 System ERROR: Call to open-ils.cstore for method open-ils.cstore.direct.actor.org_unit.search.atomic \n failed with exception: Exception: OpenSRF::EX::ERROR 2010-04-19T08:55:21 OpenILS::Application::AppUtils /openils/lib/perl5/OpenILS/Application/AppUtils.pm:179 System ERROR: Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T08:55:21 OpenSRF::AppRequest /usr/local/share/perl/5.10.0/OpenSRF/AppSession.pm:1012 <404>  An unknown server error occurred\n\n : \n\n\n\n, referer: http://libdog.mohawkcollege.ca/opac/en-CA/extras/slimpac/start.html

Use of uninitialized value $lang in string eq at /openils/lib/perl5/OpenILS/WWW/SuperCat.pm line 1025.

Use of uninitialized value $lang in string eq at /openils/lib/perl5/OpenILS/WWW/SuperCat.pm line 1070.



[Mon Apr 19 08:55:24 2010] [error] [client 142.222.234.4] Exception: OpenSRF::EX::ERROR 2010-04-19T08:55:24 main -e:0 System ERROR: Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T08:55:24 OpenSRF::AppRequest /usr/local/share/perl/5.10.0/OpenSRF/AppSession.pm:1012 <500>   *** Call to [open-ils.actor.org_unit_list.search] failed for session [1271678932.921312211.89883101706], thread trace [1]:\nException: OpenSRF::EX::ERROR 2010-04-19T08:55:24 OpenSRF::Application /usr/local/share/perl/5.10.0/OpenSRF/Application.pm:202 System ERROR: Call to open-ils.cstore for method open-ils.cstore.direct.actor.org_unit.search.atomic \n failed with exception: Exception: OpenSRF::EX::ERROR 2010-04-19T08:55:24 OpenILS::Application::AppUtils /openils/lib/perl5/OpenILS/Application/AppUtils.pm:179 System ERROR: Exception: OpenSRF::DomainObject::oilsMethodException 2010-04-19T08:55:24 OpenSRF::AppRequest /usr/local/share/perl/5.10.0/OpenSRF/AppSession.pm:1012 <404>  An unknown server error occurred\n\n : \n\n\n\n, referer: http://libdog.mohawkcollege.ca/opac/en-CA/extras/slimpac/start.html



[Mon Apr 19 09:09:02 2010] [warn] [client 142.222.234.4] incomplete redirection target of '/opac/en-CA/skin/default/xml/index.xml' for URI '/' modified to 'http://libdog.mohawkcollege.ca/opac/en-CA/skin/default/xml/index.xml'




Firebug errors

_l is not defined
http://libdog.mohawkcollege.ca//opac//common/js/org_utils.js
Line 117

globalOrgTree is undefined
http://libdog.mohawkcollege.ca//opac//common/js/init.js
Line 21


________________________________
This E-mail contains privileged and confidential information intended
only for the individual or entity named in the message. If the reader
of this message is not the intended recipient, or the agent responsible
to deliver it to the intended recipient, you are hereby notified that
any review, dissemination, distribution or copying of this communication
is prohibited. If this communication was received in error, please
notify the sender by reply E-mail immediately, and delete and destroy
the original message.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://libmail.georgialibraries.org/pipermail/open-ils-dev/attachments/20100419/77f04e37/attachment-0001.htm 


More information about the Open-ils-dev mailing list