Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Date: Tue, 5 Jul 2011 21:48:16 +0000 (UTC)
From: "Michael McCandless (JIRA)" <jira@apache.org>
To: dev@lucene.apache.org
Message-ID: 
 <622682344.1948.1309902496690.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1826029987.33245.1308837707724.JavaMail.tomcat@hel.zones.apache.org>
Subject: =?utf-8?Q?[jira]_[Updated]_(LUCENE-323?=
 =?utf-8?Q?3)_HuperDuperSynonymsFilter=E2=84=A2?=
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


     [ https://issues.apache.org/jira/browse/LUCENE-3233?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless updated LUCENE-3233:
---------------------------------------

    Attachment: LUCENE-3233.patch

New patch, adding dedup option to the builder, removing a couple nocommits,=
 cutting back on iters/counts in testRandom2.

> HuperDuperSynonymsFilter=E2=84=A2
> -------------------------
>
>                 Key: LUCENE-3233
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3233
>             Project: Lucene - Java
>          Issue Type: Improvement
>            Reporter: Robert Muir
>         Attachments: LUCENE-3223.patch, LUCENE-3233.patch, LUCENE-3233.pa=
tch, LUCENE-3233.patch, LUCENE-3233.patch, LUCENE-3233.patch
>
>
> The current synonymsfilter uses a lot of ram and cpu, especially at build=
 time.
> I think yesterday I heard about "huge synonyms files" three times.
> So, I think we should use an FST-based structure, sharing the inputs and =
outputs.
> And we should be more efficient with the tokenStream api, e.g. using save=
/restoreState instead of cloneAttributes()

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org