Return-Path: Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: (qmail 9913 invoked from network); 15 Sep 2010 04:06:20 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 15 Sep 2010 04:06:20 -0000 Received: (qmail 42547 invoked by uid 500); 15 Sep 2010 04:06:18 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 41338 invoked by uid 500); 15 Sep 2010 04:06:16 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 41305 invoked by uid 99); 15 Sep 2010 04:06:13 -0000 Received: from Unknown (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Sep 2010 04:06:13 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Sep 2010 04:05:55 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o8F45YCD028430 for ; Wed, 15 Sep 2010 04:05:34 GMT Message-ID: <30093675.195061284523534246.JavaMail.jira@thor> Date: Wed, 15 Sep 2010 00:05:34 -0400 (EDT) From: "Jason Rutherglen (JIRA)" To: dev@lucene.apache.org Subject: [jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations In-Reply-To: <22431357.61641280379919116.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12909580#action_12909580 ] Jason Rutherglen commented on LUCENE-2575: ------------------------------------------ For the posting skip list we need to implement seek on the ByteSliceReader. However if we're rewriting a portion of a slice, then I guess we could have a problem... Meaning we'd be storing an absolute position in the skip list, and we could go to look up the value, however that byte(s) could have been altered to not be delta encoded doc ids anymore, but instead is/are the forwarding address to the next slice. Do we need an intelligent mechanism that interacts with the byte slice writer to not point at byte array elements (ie the end of slices) that could later be converted into forwarding addresses? > Concurrent byte and int block implementations > --------------------------------------------- > > Key: LUCENE-2575 > URL: https://issues.apache.org/jira/browse/LUCENE-2575 > Project: Lucene - Java > Issue Type: Improvement > Components: Index > Affects Versions: Realtime Branch > Reporter: Jason Rutherglen > Fix For: Realtime Branch > > Attachments: LUCENE-2575.patch, LUCENE-2575.patch, LUCENE-2575.patch, LUCENE-2575.patch > > > The current *BlockPool implementations aren't quite concurrent. > We really need something that has a locking flush method, where > flush is called at the end of adding a document. Once flushed, > the newly written data would be available to all other reading > threads (ie, postings etc). I'm not sure I understand the slices > concept, it seems like it'd be easier to implement a seekable > random access file like API. One'd seek to a given position, > then read or write from there. The underlying management of byte > arrays could then be hidden? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org