lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dawid Weiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-4138) Update morfologik (polish stemming) to 1.5.3
Date Mon, 25 Jun 2012 19:47:44 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400818#comment-13400818
] 

Dawid Weiss commented on LUCENE-4138:
-------------------------------------

This will be trickier than I initially thought because of data format changes in Morfologik.
Tags have been normalized (expanded) so what previously returned:

> WordData[liście,liść,subst:pl:acc.nom.voc:m3]
> WordData[liście,list,subst:sg:loc.voc:m3]
> WordData[liście,lista,subst:sg:dat.loc:f]

now returns:

> WordData[liście,liście,subst:sg:acc:n2]
> WordData[liście,liście,subst:sg:nom:n2]
> WordData[liście,liście,subst:sg:voc:n2]
> WordData[liście,liść,subst:pl:acc:m3]
> WordData[liście,liść,subst:pl:nom:m3]
> WordData[liście,liść,subst:pl:voc:m3]
> WordData[liście,list,subst:sg:loc:m3]
> WordData[liście,list,subst:sg:voc:m3]
> WordData[liście,lista,subst:sg:dat:f]
> WordData[liście,lista,subst:sg:loc:f]

which generates lots of identical base forms with a variable candidate tag. I think this will
require patching to simulate previous behavior (single base form, multiple-tags attribute).
I think modifying MorphosyntacticTagAttribute to carry a list of tags for the current form
is a way to go. This would be a non-compatible change (which may just as well be good for
4.x).


                
> Update morfologik (polish stemming) to 1.5.3
> --------------------------------------------
>
>                 Key: LUCENE-4138
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4138
>             Project: Lucene - Java
>          Issue Type: Improvement
>            Reporter: Dawid Weiss
>            Assignee: Dawid Weiss
>            Priority: Trivial
>             Fix For: 4.0, 5.0
>
>
> Just released. Updates to the dictionary but most of all -- it comes with a clean BSD
license (including dictionary data).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message