incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron McCurry (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BLUR-290) NRT Updates using RAMDirectory & Swap
Date Tue, 19 Nov 2013 00:47:22 GMT

    [ https://issues.apache.org/jira/browse/BLUR-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13826004#comment-13826004
] 

Aaron McCurry commented on BLUR-290:
------------------------------------

This code is looking very promising, I really like the approach you are taking.  Do you have
any numbers yet on performance?  If not I will do a little evaluation of where the code is
performance wise.

Also I'm thinking that we might want to introduce table types in Blur to allow for plugging
in various implementations of the BlurIndex.  That way this more performant indexing implementation
could be used instead of the normal NRT or the ReadOnly variation.  I also thought of another
possible implementation, it would allow for varying latency between writes and visibility.
 Basically under load it would allow the indexer to fall behind but would still allow for
mutates to occur as fast as possible.

> NRT Updates using RAMDirectory & Swap
> -------------------------------------
>
>                 Key: BLUR-290
>                 URL: https://issues.apache.org/jira/browse/BLUR-290
>             Project: Apache Blur
>          Issue Type: New Feature
>    Affects Versions: experimental-dev
>            Reporter: Ravikumar
>         Attachments: BlurFieldsConsumer.java, BlurFieldsConsumer.java, BlurFlushingIndexWriter.java,
BlurIndexTracker.java, BlurPostingsConsumer.java, BlurPostingsFormat.java, BlurRealTimeIndex.java,
BlurRealTimeIndexWriter.java, BlurRealTimeManager.java, BlurRealTimeManagerReopenThread.java,
BlurRowCodec.java, BlurTermsConsumer.java, CompressingRowIndexReader.java, CompressingRowIndexWriter.java,
CompressingRowReader.java, CompressingRowReader.java, CompressingRowWriter.java, CompressingRowWriter.java,
GrowableByteArrayDataOutput.java, PrimeDocCache.java, RealTimeTransactionRecorder.java, RowCache.java,
RowDocsCollector.java, RowReaderCache.java, SlabAllocator.java, SlabRAMDirectory.java, SlabRAMFile.java,
SlabRAMInputStream.java, SlabRAMOutputStream.java, SortingMultiReader.java, SortingMultiReader.java,
TestCompressingRowWriter.java
>
>
> We have been discussing about handling humungous rows in Blur (BLUR-220). Explore the
idea of using RAMDirectory at the front, backed by persistent-index.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message