Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of
 ravikumar.govindarajan@gmail.com designates 209.85.212.175 as permitted
 sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEY5pxXzb1kpMueUD=X1PVE+vB0DCNQVmYtwp0My_yMEPuxJUA@mail.gmail.com>
References: 
 <CAGW2whRbvDpAJq7qW=6OGbO+zje3-tPpEyLPKdFtWZt17q7fXA@mail.gmail.com>
	<CAEY5pxXzb1kpMueUD=X1PVE+vB0DCNQVmYtwp0My_yMEPuxJUA@mail.gmail.com>
Date: Tue, 17 Feb 2015 17:12:06 +0530
Message-ID: 
 <CAGW2whRp4pQu5xrhZiTUvBxgYKRGccu8O2W1g6KHBa9dQrhNKA@mail.gmail.com>
Subject: Re: URL/Email tokenizer
From: Ravikumar Govindarajan <ravikumar.govindarajan@gmail.com>
To: "java-user@lucene.apache.org" <java-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary=e89a8f83a05933844e050f473100

--e89a8f83a05933844e050f473100
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Thanks Ian

What I am currently doing is duplicating the data into 2 different fields
and having my own PerFieldAnalyzerWrapper just like you pointed out

Is there a good way to do this in a single-pass? Like how Bi-Grams or
Common-Grams do=E2=80=A6

--
Ravi

On Tue, Feb 17, 2015 at 3:08 PM, Ian Lea <ian.lea@gmail.com> wrote:

> Sounds like a job for
> org.apache.lucene.analysis.miscellaneous.PerFieldAnalyzerWrapper.
>
>
> --
> Ian.
>
>
> On Tue, Feb 17, 2015 at 8:51 AM, Ravikumar Govindarajan
> <ravikumar.govindarajan@gmail.com> wrote:
> > We have a requirement in that E-mail addresses need to be added in a
> > tokenized form to one field while untokenized form is added to another
> field
> >
> > Ex:
> >
> > "I have mailed abc@xyz.com" . It should tokenize as below
> >
> > body =3D {"I", "have", "mailed", "abc", "xyz", "com"};
> >
> > I also have a body-addr field. Tokenizer needs to extract e-mail
> addresses
> > from body field and add them as below
> >
> > body-addr =3D {"abc@xyz.com"}
> >
> > How to achieve this via tokenizer chain?
> >
> > --
> > Ravi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

--e89a8f83a05933844e050f473100--