Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of erickerickson@gmail.com
 designates 209.85.216.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=G8odVrJTq1LHTgH3aG25Iv51aZpDugbFCKCtthMB2P604NVyJGpdCYiheio9v1jISL
         0JNu0mV9z0p693VxpTmrtmifyC0ZrAdbZtQ4qd5D0PWVCVicBgW9iHEgK2M+RFBWCPSr
         DIGqu67Sx3ufzadX4Q6MclqSTuD9MAmdHdmsk=
MIME-Version: 1.0
In-Reply-To: <1293943524498-2178710.post@n3.nabble.com>
References: <151986.56456.qm@web114720.mail.gq1.yahoo.com>
	<AANLkTinVW4-BoB_-ppPu4So+Su-Jrsbo=J2riwhQm=7g@mail.gmail.com>
	<1293918442597-2177453.post@n3.nabble.com>
	<AANLkTi=zFAHr60UJCXCL-NBuHU1S6qF4726FDtoULWpG@mail.gmail.com>
	<1293943524498-2178710.post@n3.nabble.com>
Date: Sun, 2 Jan 2011 10:59:04 -0500
Message-ID: <AANLkTin4YcyeGR2DRRBxdExZ-_gix=_qYg1Wvt01+Fq9@mail.gmail.com>
Subject: Re: parsing Java log file with Lucene 3.0.3
From: Erick Erickson <erickerickson@gmail.com>
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=0016364ee4046294c70498df1d4c

--0016364ee4046294c70498df1d4c
Content-Type: text/plain; charset=ISO-8859-1

Some days I just can't read...

First question: Why do you require standard analyzer?Are you really making
use of
the special processing? Take a look at other analyzer options.
PatternAnalyzer,
SimpleAnalyzer, etc.

If you really require StandardAnalyzer, consider using two fields.
field_original
and field_processed. Store (but don't index) the original string in
field_original.
pre-process and analyze (but don't store)  in field_processed. Search
against field_processed and display from field_original.

This won't bloat your index, since the operations are orthogonal anyway.

Best
Erick

On Sat, Jan 1, 2011 at 11:45 PM, Benzion G <benzionk@yahoo.com> wrote:

>
> Of course I want to store and then show to user the original message.
> That's
> why I can't change it and the place to handle the dots is the Analyzer
> area.
> So how can I make the StandardAnalyzer to handle dots as commas?
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/parsing-Java-log-file-with-Lucene-3-0-3-tp2173046p2178710.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

--0016364ee4046294c70498df1d4c--