lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (JIRA)" <>
Subject [jira] [Commented] (LUCENE-3092) NRTCachingDirectory, to buffer small segments in a RAMDir
Date Mon, 16 May 2011 19:52:47 GMT


Simon Willnauer commented on LUCENE-3092:

mike I attached a patch to LUCENE-3100 and tested with the latest patch on this issue. The
test randomly fails (after I close the IW in the test!) here is a trace:


    [junit] Testsuite:
    [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.16 sec
    [junit] ------------- Standard Error -----------------
    [junit] NOTE: reproduce with: ant test -Dtestcase=TestNRTCachingDirectory -Dtestmethod=testNRTAndCommit
    [junit] NOTE: test params are: codec=RandomCodecProvider: {docid=SimpleText, body=MockFixedIntBlock(blockSize=1993),
title=Pulsing(freqCutoff=3), titleTokenized=MockSep, date=SimpleText}, locale=ar_AE, timezone=America/Santa_Isabel
    [junit] NOTE: all tests run in this JVM:
    [junit] [TestNRTCachingDirectory]
    [junit] NOTE: Mac OS X 10.6.7 x86_64/Apple Inc. 1.6.0_24 (64-bit)/cpus=2,threads=1,free=46213552,total=85000192
    [junit] ------------- ---------------- ---------------
    [junit] Testcase: testNRTAndCommit(	FAILED
    [junit] limit=12 actual=16
    [junit] junit.framework.AssertionFailedError: limit=12 actual=16
    [junit] 	at org.apache.lucene.index.RandomIndexWriter.doRandomOptimize(
    [junit] 	at org.apache.lucene.index.RandomIndexWriter.close(
    [junit] 	at
    [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(
    [junit] 	at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(
    [junit] Test FAILED

> NRTCachingDirectory, to buffer small segments in a RAMDir
> ---------------------------------------------------------
>                 Key: LUCENE-3092
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: core/store
>            Reporter: Michael McCandless
>            Priority: Minor
>             Fix For: 3.2, 4.0
>         Attachments: LUCENE-3092-listener.patch, LUCENE-3092.patch, LUCENE-3092.patch,
> I created this simply Directory impl, whose goal is reduce IO
> contention in a frequent reopen NRT use case.
> The idea is, when reopening quickly, but not indexing that much
> content, you wind up with many small files created with time, that can
> possibly stress the IO system eg if merges, searching are also
> fighting for IO.
> So, NRTCachingDirectory puts these newly created files into a RAMDir,
> and only when they are merged into a too-large segment, does it then
> write-through to the real (delegate) directory.
> This lets you spend some RAM to reduce I0.

This message is automatically generated by JIRA.
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message