lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1540) Improvements to contrib.benchmark for TREC collections
Date Sun, 06 Feb 2011 12:19:31 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12991145#comment-12991145
] 

Michael McCandless commented on LUCENE-1540:
--------------------------------------------

I think this commit has caused a failure on at least 3.x?
{noformat}
[junit] Testcase: testTrecFeedDirAllTypes(org.apache.lucene.benchmark.byTask.feeds.TrecContentSourceTest):
Caused an ERROR
    [junit] expected:<TEST-00[0]> but was:<TEST-00[1]>
    [junit] 	at org.apache.lucene.benchmark.byTask.feeds.TrecContentSourceTest.assertDocData(TrecContentSourceTest.java:70)
    [junit] 	at org.apache.lucene.benchmark.byTask.feeds.TrecContentSourceTest.testTrecFeedDirAllTypes(TrecContentSourceTest.java:369)
    [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1045)
    [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:977)
    [junit] 
    [junit] 
    [junit] Tests run: 6, Failures: 0, Errors: 1, Time elapsed: 0.488 sec
    [junit] 
    [junit] ------------- Standard Error -----------------
    [junit] WARNING: test method: 'testBadDate' left thread running: Thread[Thread-6,5,main]
    [junit] RESOURCE LEAK: test method: 'testBadDate' left 1 thread(s) running
    [junit] NOTE: reproduce with: ant test -Dtestcase=TrecContentSourceTest -Dtestmethod=testBadDate
-Dtests.seed=-1485993969467368126:6510043524258948665 -Dtests.multiplier=5
    [junit] NOTE: reproduce with: ant test -Dtestcase=TrecContentSourceTest -Dtestmethod=testTrecFeedDirAllTypes
-Dtests.seed=-1485993969467368126:-9055415333820766139 -Dtests.multiplier=5
    [junit] NOTE: test params are: locale=tr_TR, timezone=Europe/Zagreb
    [junit] NOTE: all tests run in this JVM:
    [junit] [TrecContentSourceTest]
    [junit] NOTE: FreeBSD 8.2-RC2 amd64/Sun Microsystems Inc. 1.6.0 (64-bit)/cpus=16,threads=1,free=66439840,total=86376448
    [junit] ------------- ---------------- ---------------
{noformat}

> Improvements to contrib.benchmark for TREC collections
> ------------------------------------------------------
>
>                 Key: LUCENE-1540
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1540
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: contrib/benchmark
>            Reporter: Tim Armstrong
>            Assignee: Doron Cohen
>            Priority: Minor
>             Fix For: 3.1, 4.0
>
>         Attachments: LUCENE-1540.patch, LUCENE-1540.patch, LUCENE-1540.patch, LUCENE-1540.patch,
trecdocs.zip
>
>
> The benchmarking utilities for  TREC test collections (http://trec.nist.gov) are quite
limited and do not support some of the variations in format of older TREC collections.  
> I have been doing some benchmarking work with Lucene and have had to modify the package
to support:
> * Older TREC document formats, which the current parser fails on due to missing document
headers.
> * Variations in query format - newlines after <title> tag causing the query parser
to get confused.
> * Ability to detect and read in uncompressed text collections
> * Storage of document numbers by default without storing full text.
> I can submit a patch if there is interest, although I will probably want to write unit
tests for the new functionality first.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message