Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Date: Thu, 5 May 2011 16:25:03 +0000 (UTC)
From: "Olivier Favre (JIRA)" <jira@apache.org>
To: dev@lucene.apache.org
Message-ID: 
 <1716279138.25101.1304612703198.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1892190426.21900.1304525403817.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (LUCENE-3071) PathHierarchyTokenizer adaptation
 for urls: splits reversed
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/LUCENE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029413#comment-13029413 ] 

Olivier Favre commented on LUCENE-3071:
---------------------------------------

{{ant clean test}} did it for me, thanks!

As for the failing tests, it is because of the {{finalOffset}} that I set to {{path.length()}}.
I'm not sure whether I should use {{path.length()}}, as my tokens don't go up to there when using the reverse mode.
When I take a look at the the end() function, I think that I "should" set it to the end of the string. But I can't see it on the javadoc.
If the purpose of the {{finalOffset}} parameter in {{assertTokenStreamContents()}} it to make sure of the {{endOffset}} of the last term, then I should not use {{path.length()}} blindly when using reverse and skip.

Can you help me with the purpose of {{finalOffset}}? Or can I simply skip it in my tests (they are working if I skip it)?

Thanks

> PathHierarchyTokenizer adaptation for urls: splits reversed
> -----------------------------------------------------------
>
>                 Key: LUCENE-3071
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3071
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: contrib/analyzers
>            Reporter: Olivier Favre
>            Priority: Minor
>         Attachments: LUCENE-3071.patch, ant.log.tar.bz2
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> {{PathHierarchyTokenizer}} should be usable to split urls the a "reversed" way (useful for faceted search against urls):
> {{www.site.com}} -> {{www.site.com, site.com, com}}
> Moreover, it should be able to skip a given number of first (or last, if reversed) tokens:
> {{/usr/share/doc/somesoftware/INTERESTING/PART}}
> Should give with 4 tokens skipped:
> {{INTERESTING}}
> {{INTERESTING/PART}}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org