incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravikumar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BLUR-290) NRT Updates using RAMDirectory & Swap
Date Thu, 14 Nov 2013 14:37:39 GMT

     [ https://issues.apache.org/jira/browse/BLUR-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravikumar updated BLUR-290:
---------------------------

    Attachment: RowCache.java
                GrowableByteArrayDataOutput.java
                CompressingRowIndexReader.java
                CompressingRowIndexWriter.java
                TestCompressingRowWriter.java
                CompressingRowWriter.java
                CompressingRowReader.java
                BlurPostingsConsumer.java
                BlurRowCodec.java
                BlurPostingsFormat.java
                BlurFieldsConsumer.java
                BlurTermsConsumer.java

I am attaching some untested source files here. It only takes care of the writing part.

How exactly it interacts with reading/scoring/segment-file-deletes etc..., I am still trying
to find

But I am pretty sure that once we are able to locate the RowId for a given DocId cheaply,
doing aggregate-scores, super-scores etc... should be simple. [Something like Lucene-Join-Util's
TermsWithScoreCollector class]

Please take a look at the attached sources and let me know your views on this and if my direction
is correct

> NRT Updates using RAMDirectory & Swap
> -------------------------------------
>
>                 Key: BLUR-290
>                 URL: https://issues.apache.org/jira/browse/BLUR-290
>             Project: Apache Blur
>          Issue Type: New Feature
>    Affects Versions: experimental-dev
>            Reporter: Ravikumar
>         Attachments: BlurFieldsConsumer.java, BlurFlushingIndexWriter.java, BlurIndexTracker.java,
BlurPostingsConsumer.java, BlurPostingsFormat.java, BlurRealTimeIndex.java, BlurRealTimeIndexWriter.java,
BlurRealTimeManager.java, BlurRealTimeManagerReopenThread.java, BlurRowCodec.java, BlurTermsConsumer.java,
CompressingRowIndexReader.java, CompressingRowIndexWriter.java, CompressingRowReader.java,
CompressingRowWriter.java, GrowableByteArrayDataOutput.java, RealTimeTransactionRecorder.java,
RowCache.java, SlabAllocator.java, SlabRAMDirectory.java, SlabRAMFile.java, SlabRAMInputStream.java,
SlabRAMOutputStream.java, SortingMultiReader.java, TestCompressingRowWriter.java
>
>
> We have been discussing about handling humungous rows in Blur (BLUR-220). Explore the
idea of using RAMDirectory at the front, backed by persistent-index.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message