Return-Path: Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: (qmail 59476 invoked from network); 13 Sep 2010 16:25:56 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 13 Sep 2010 16:25:56 -0000 Received: (qmail 15039 invoked by uid 500); 13 Sep 2010 16:25:55 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 14966 invoked by uid 500); 13 Sep 2010 16:25:54 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 14959 invoked by uid 99); 13 Sep 2010 16:25:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Sep 2010 16:25:54 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Sep 2010 16:25:54 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o8DGPXCf000533 for ; Mon, 13 Sep 2010 16:25:34 GMT Message-ID: <15586994.155871284395133860.JavaMail.jira@thor> Date: Mon, 13 Sep 2010 12:25:33 -0400 (EDT) From: "Jason Rutherglen (JIRA)" To: dev@lucene.apache.org Subject: [jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations In-Reply-To: <22431357.61641280379919116.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12908849#action_12908849 ] Jason Rutherglen commented on LUCENE-2575: ------------------------------------------ One thing I noticed, correct me if I'm wrong, is the term doc frequency (the one stored per term, ie, TermsEnum.docFreq) doesn't seem to be currently recorded in the ram buffer code tree. It will be easy to add, though if we make it accurate per RAM index reader then we could be allocating a unique array, the length of the number of terms, per reader. I'll implement it this way to start and we can change it later if necessary. Actually, to save RAM this could be another use case where a 2 dimensional copy-on-write array is practical. > Concurrent byte and int block implementations > --------------------------------------------- > > Key: LUCENE-2575 > URL: https://issues.apache.org/jira/browse/LUCENE-2575 > Project: Lucene - Java > Issue Type: Improvement > Components: Index > Affects Versions: Realtime Branch > Reporter: Jason Rutherglen > Fix For: Realtime Branch > > Attachments: LUCENE-2575.patch, LUCENE-2575.patch > > > The current *BlockPool implementations aren't quite concurrent. > We really need something that has a locking flush method, where > flush is called at the end of adding a document. Once flushed, > the newly written data would be available to all other reading > threads (ie, postings etc). I'm not sure I understand the slices > concept, it seems like it'd be easier to implement a seekable > random access file like API. One'd seek to a given position, > then read or write from there. The underlying management of byte > arrays could then be hidden? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org