lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Rowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (LUCENE-3037) TestFSTs.testRealTerms produces a corrupt index
Date Tue, 19 Apr 2011 20:45:06 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021783#comment-13021783
] 

Steven Rowe commented on LUCENE-3037:
-------------------------------------

The original method was waaaaaaaaay slower.  I added this to my test:

{code:java}
  int[] log0Results = new int[iterations];
  ...
  start = System.currentTimeMillis();
  for (int i = 0 ; i < iterations ; ++i) {
    log0Results[i] = (docFreqs[i] == 0 
                   ? 0 : (int) Math.floor( StrictMath.log(docFreqs[i]) 
                                         / StrictMath.log(skipIntervals[i])));
  }
  stop = System.currentTimeMillis();
  System.err.println("log0: " + (stop - start) + "ms for " + iterations + " iterations.");
{code}

Result:

{noformat}
log0: 17933ms for 100000000 iterations.
log1: 2420ms for 100000000 iterations.
log2: 1139ms for 100000000 iterations.
log3: 1697ms for 100000000 iterations.
{noformat}

> TestFSTs.testRealTerms produces a corrupt index
> -----------------------------------------------
>
>                 Key: LUCENE-3037
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3037
>             Project: Lucene - Java
>          Issue Type: Bug
>            Reporter: Robert Muir
>             Fix For: 4.0
>
>         Attachments: LUCENE-3037.patch, LUCENE-3037_test.patch, index.7z.001, index.7z.002,
index.7z.003
>
>
> seems to be prox/skip related: the test passes, but the checkindex upon closing fails.
> ant test-core -Dtestcase=TestFSTs -Dtests.seed=-4012305283315171209:0 -Dtests.multiplier=3
-Dtests.nightly=true -Dtests.linedocsfile=c:/data/enwiki.random.lines.txt.gz
> Note: to get the enwiki.random.lines.txt.gz you have to fetch it from hudson (warning
1 gigabyte file).
> you also have to run the test a few times to trigger it.
> ill upload the index this thing makes to this issue.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message