[OPEN-ILS-GENERAL] Z39.50 server indexes?

[Linda Jansova]

Hi,

I have been trying to resolve the Z39.50 encoding mystery and two more 
questions have emerged in the process:

1) What actually happens in Evergreen when one submits a yaz query like 
find matoušek (via Z39.50)?

 From config.index_normalizer (and also from 
http://wiki.evergreen-ils.org/doku.php?id=documentation:indexing) it is 
clear that during indexing diacritics are thrown away (Strip Diacritics 
- Convert text to NFD form and remove non-spacing combining marks.). I 
would then assume that similar normalization would be performed on OPAC 
(or staff client) queries to make sure strings from indexes and from 
queries have a chance to meet. Is it also the case of Z39.50 queries?

2) How does this process differ from what happens when one searches a 
specific field (or index), such as author or title?

Apart from our (Jabok) catalog I have also tried to send a query to 
Laurentian Univesity catalog (using access information from 
http://irspy.indexdata.com/ap.html?id=Z39.50:laurentian.concat.ca:210/OSUL&set=bib-1). 
It works okay when no search fields such as author or title are 
specified but when they are, it only works okay for queries without 
diacritics:

Z> open laurentian.concat.ca:210/OSUL
Connecting...OK.
Sent initrequest.
Connection accepted by v3 target.
ID     : 81/81
Name   : Simple2ZOOM Universal Gateway/GFS/YAZ
Version: 1.04/5.15.2 738b345708b245e67cded6d917393a80b5bd4eca
Options: search present delSet triggerResourceCtrl scan sort namedResultSets
Elapsed: 0.990590
Z> find @attr 1=21 francais
Sent searchRequest.
Received SearchResponse.
Search was a success.
Number of hits: 7879, setno 1
records returned: 0
Elapsed: 7.993394
Z> find @attr 1=21 français
Sent searchRequest.
Received SearchResponse.
Search was a success.
Number of hits: 0, setno 2
records returned: 0
Elapsed: 1.658774

So it is not probably just our issue...

Linda

On 24.2.2016 07:50, Linda Jansova wrote:
>
> Hi,
>
> We have still haven't sorted out our Z39.50 server encoding issues but 
> hopefully have made some steps which may help us locate and solve the 
> problem. (We currently work with Evergreen 2.8.3.)
>
> Problem summary:
>
> When querying our Z39.50 server (mojzis.jabok.cuni.cz:9999/Jabok) via 
> yaz, query find matoušek works okay, so does query find @attr 1=1016 
> Matousek. But with find @attr 1=1016 Matoušek zero number of hits is 
> returned.
>
> When searching directly via SRU (in our case 
> http://mojzis.jabok.cuni.cz/opac/extras/sru) all queries (with the 
> exception of find dc.creator=matoušek) seem to work okay, e.g. find 
> eg.author=matoušek reports 32 hits.
>
> A more detailed view:
>
> We have been digging into this for quite some time now (our previous 
> posts are available at 
> https://www.mail-archive.com/open-ils-general@list.georgialibraries.org/msg11117.html 
> and<https://www.mail-archive.com/open-ils-general%40list.georgialibraries.org/msg11442.html>https://www.mail-archive.com/open-ils-general%40list.georgialibraries.org/msg11442.html). 
>
>
> We have also tried to get in touch with the yaz community 
> (http://lists.indexdata.dk/pipermail/yazlist/2016-February/004159.html). 
> They have advised us to have a look at the indexes.
>
> We have had a look at the config.z3950_index_field_map. It looks like 
> this in our installation:
>
> id | label | metabib_field | record_attr | z3950_attr | z3950_attr_type
>
> ----+-----------+---------------+-------------+------------+-----------------
>
> 1 | Title | 5 | | | title
>
> 2 | Author | 8 | | | author
>
> 3 | ISBN | 18 | | | isbn
>
> 4 | ISSN | 19 | | | issn
>
> 5 | LCCN | 30 | | | lccn
>
> 6 | Pubdate | | pubdate | | pubdate
>
> 7 | Item Type | | item_type | | item_type
>
> (7 rows)
>
> But we are not sure whether it is a configuration related to Evergreen 
> Z39.50 server or to Evergreen Z39.50 client. If it is a server 
> configuration, is everything included or are some data missing?
>
> Our current dgo.conf looks like this:
>
> <client>
>
> <database name="Jabok">
>
> <zurl>http://mojzis.jabok.cuni.cz/opac/extras/sru</zurl>
>
> <option name="sru">get</option>
>
> <charset>utf-8</charset>
>
> <search>
>
> <querytype>cql</querytype>
>
> <map use="4"><index>eg.title</index></map>
>
> <map use="7"><index>eg.keyword</index></map>
>
> <map use="8"><index>eg.keyword</index></map>
>
> <map use="21"><index>eg.subject</index></map>
>
> <map use="1003"><index>eg.author</index></map>
>
> <map use="1018"><index>eg.publisher</index></map>
>
> <map use="1035"><index>eg.keyword</index></map>
>
> <map use="1016"><index>eg.keyword</index></map>
>
> </search>
>
> </database>
>
> </client>
>
> But where are the indexes actually defined? Is it in the 
> config.metabib_field table?
> (Our current config.metabib_field table is attached to this message.)
>
> Any hints that could help us have our Z39.50 server work as expected 
> are more than welcome!
>
> Thank you in advance!
>
> Linda
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://libmail.georgialibraries.org/pipermail/open-ils-general/attachments/20160228/472dae90/attachment.html>