From java-user-return-42160-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Fri Sep 04 08:30:17 2009 Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 54044 invoked from network); 4 Sep 2009 08:30:17 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Sep 2009 08:30:17 -0000 Received: (qmail 56825 invoked by uid 500); 4 Sep 2009 08:30:15 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 56757 invoked by uid 500); 4 Sep 2009 08:30:15 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 56747 invoked by uid 99); 4 Sep 2009 08:30:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Sep 2009 08:30:15 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [91.121.16.47] (HELO ns23917.ovh.net) (91.121.16.47) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Sep 2009 08:30:03 +0000 Received: (qmail 8801 invoked by uid 508); 4 Sep 2009 08:34:43 -0000 Received: from unknown (HELO spotter-dclnx) (88.182.17.109) by ns23917.ovh.net with AES256-SHA encrypted SMTP; 4 Sep 2009 08:34:43 -0000 Received: from techno by spotter-dclnx with local (Exim 4.69) (envelope-from ) id 1MjUAm-0001xa-SE for java-user@lucene.apache.org; Fri, 04 Sep 2009 10:29:32 +0200 Date: Fri, 4 Sep 2009 10:29:32 +0200 From: David Causse To: java-user@lucene.apache.org Subject: Re: Use of tika for parsing, offsets questions Message-ID: <20090904082932.GA12797@spotter-dclnx> Mail-Followup-To: David Causse , java-user@lucene.apache.org References: <20090902124006.GA32711@spotter-dclnx> <510143ac0909030607o510f6d0ftef81357fad1ff25a@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <510143ac0909030607o510f6d0ftef81357fad1ff25a@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) X-Virus-Checked: Checked by ClamAV on apache.org On Thu, Sep 03, 2009 at 03:07:18PM +0200, Jukka Zitting wrote: > Hi, > > On Wed, Sep 2, 2009 at 2:40 PM, David Causse wrote: > > If I use tika for parsing HTML code and inject parsed String to a lucene > > analyzer. What about the offset information for KWIC and return to text > > (like the google cache view)? how can I keep track of the offsets > > between tika parser and lucene analyzer? > > Currently Tika doesn't expose that information but the Tika Parser API > was designed for such use in mind, so it will be possible to add the > offset information. Please file a Tika feature request [1] for this. I created TIKA-272, the idea behind is to be able to use unmodified lucene analyzers with tika and keep offset correctness. Thank you. -- David Causse Spotter http://www.spotter.com/ --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org