Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Date: Tue, 28 Jun 2011 21:31:28 +0000 (UTC)
From: =?utf-8?Q?Micha=C5=82_Dybizba=C5=84ski_=28JIRA=29?= <jira@apache.org>
To: dev@lucene.apache.org
Message-ID: 
 <1164584126.176.1309296688734.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Updated] (LUCENE-2341) explore morfologik integration
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


     [ https://issues.apache.org/jira/browse/LUCENE-2341?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:all-tabpanel ]

Micha=C5=82 Dybizba=C5=84ski updated LUCENE-2341:
---------------------------------------

    Attachment: LUCENE-2341.diff

Dawid, I'm attaching a patch with the suggested changes:

1. MorfologikAnalyzer now doesn't use a LowerCaseFilter. When IStemmer.look=
up returns an empty list for an originally cased token, another lookup is m=
ade for lowercased one. I hope the test case reflects your intentions.

2. I've added MorfologikPOSAttributeImpl class that provides information ab=
out morphosyntactic annotations for each lemma, obtained with WordData.getT=
ag(). A test provides a short insight for potential users. Two notes here:
  a) Since MorfologikPOSAttribute might be unused, I've implemented it in t=
erms of CharSequence (and not String), to not convert prematurely each POS =
tag to String.
  b) Currently a default POS (for a nonlemmatized token) is an empty String=
, however null value might be more distinctive if empty POS tags for lemma =
were allowed.

BTW, the patch deletes one line from dev-tools/eclipse/dot.classpath (<clas=
spathentry kind=3D"src" path=3D"modules/queries/src/test"/>) - was that int=
entional ?


> explore morfologik integration
> ------------------------------
>
>                 Key: LUCENE-2341
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2341
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: modules/analysis
>            Reporter: Robert Muir
>            Assignee: Dawid Weiss
>         Attachments: LUCENE-2341.diff, LUCENE-2341.diff, LUCENE-2341.diff=
, LUCENE-2341.diff, LUCENE-2341.patch, morfologik-fsa-1.5.2.jar, morfologik=
-polish-1.5.2.jar, morfologik-stemming-1.5.2.jar
>
>
> Dawid Weiss mentioned on LUCENE-2298 that there is another Polish stemmer=
 available:
> http://sourceforge.net/projects/morfologik/
> This works differently than LUCENE-2298, and ideally would be another opt=
ion for users.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org