Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CF3999EF4 for ; Thu, 8 Dec 2011 11:05:02 +0000 (UTC) Received: (qmail 62262 invoked by uid 500); 8 Dec 2011 11:05:01 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 62217 invoked by uid 500); 8 Dec 2011 11:05:01 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 62210 invoked by uid 99); 8 Dec 2011 11:05:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2011 11:05:01 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2011 11:04:59 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id E92F71072FA for ; Thu, 8 Dec 2011 11:04:39 +0000 (UTC) Date: Thu, 8 Dec 2011 11:04:39 +0000 (UTC) From: "Michael McCandless (Assigned) (JIRA)" To: dev@lucene.apache.org Message-ID: <595187185.53097.1323342279956.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1035521501.50586.1323289000153.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Assigned] (LUCENE-3627) CorruptIndexException on indexing after a failure occurs after segments file creation but before any bytes are written MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/LUCENE-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless reassigned LUCENE-3627: ------------------------------------------ Assignee: Michael McCandless > CorruptIndexException on indexing after a failure occurs after segments file creation but before any bytes are written > ---------------------------------------------------------------------------------------------------------------------- > > Key: LUCENE-3627 > URL: https://issues.apache.org/jira/browse/LUCENE-3627 > Project: Lucene - Java > Issue Type: Bug > Affects Versions: 3.5 > Environment: lucene-3.5.0, src download from GA release lucene.apache.org. > Mac OS X 10.6.5, running tests in Eclipse Build id: 20100218-1602, > java version "1.6.0_24" > Java(TM) SE Runtime Environment (build 1.6.0_24-b07-334-10M3326) > Java HotSpot(TM) 64-Bit Server VM (build 19.1-b02-334, mixed mode) > Reporter: Ken McCracken > Assignee: Michael McCandless > Priority: Critical > Attachments: LUCENE-3627_initial_proposal.txt, TestCrashCausesCorruptIndex.java > > Original Estimate: 48h > Remaining Estimate: 48h > > FSDirectory.createOutput(..) uses a RandomAccessFile to do its work. On my system the default FSDirectory.open(..) creates an NIOFSDirectory. If createOutput is called on a segments_* file and a crash occurs between RandomAccessFile creation (file system shows a segments_* file exists but has zero bytes) but before any bytes are written to the file, subsequent IndexWriters cannot proceed. The difficulty is that it does not know how to clear the empty segments_* file. None of the file deletions will happen on such a segment file because the opening bytes cannot not be read to determine format and version. > An initial proposed patch file is attached below. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org