Return-Path: X-Original-To: apmail-lucene-java-user-archive@www.apache.org Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D2051D4F1 for ; Wed, 31 Oct 2012 12:35:17 +0000 (UTC) Received: (qmail 99257 invoked by uid 500); 31 Oct 2012 12:35:15 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 99175 invoked by uid 500); 31 Oct 2012 12:35:15 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 99011 invoked by uid 99); 31 Oct 2012 12:35:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 Oct 2012 12:35:14 +0000 X-ASF-Spam-Status: No, hits=1.3 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL,URI_HEX X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.160.48] (HELO mail-pb0-f48.google.com) (209.85.160.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 Oct 2012 12:35:08 +0000 Received: by mail-pb0-f48.google.com with SMTP id wy7so988591pbc.35 for ; Wed, 31 Oct 2012 05:34:46 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=T9A1mC8LsITbWuAlJIMF8yngpkajn+Zn8lETxJOQkNs=; b=Hd8rMavXspxQwWKynQ8JHFQE0P/wKfiDueD5xwzP/PJjnrKZohv6OskWY54w5iNtJs 7xe8QM3Ht30SVlragBrIm+Zd45apf6hP6fOW5PjZ1KQcQeoCo2O5kLiIoabKttETKGLN VYFH2qHkiPnE2V6Qg9Flw5d1LvqzG4CmiPMtk9pO7p+4m09IuhsF1r2DKcf6D2DmFO0p ZqdhEO1W+QrZKKBFSIELCBm2Ot96EQMCxBUlsZKk2H8+UKhLwUI/T7rSzyJ/0lYNgW7Z OVLT9J43Q8UFFGkeEQevQLTUI2ktPJ+eHeqeyRzTVFzyag4QkNVVsZixLC9T9GYy6UfN H9PQ== Received: by 10.68.197.71 with SMTP id is7mr112029568pbc.79.1351686886641; Wed, 31 Oct 2012 05:34:46 -0700 (PDT) MIME-Version: 1.0 Received: by 10.68.152.67 with HTTP; Wed, 31 Oct 2012 05:34:26 -0700 (PDT) In-Reply-To: <1351654066852-4017179.post@n3.nabble.com> References: <1351654066852-4017179.post@n3.nabble.com> From: Michael McCandless Date: Wed, 31 Oct 2012 08:34:26 -0400 Message-ID: Subject: Re: "read past EOF" when merge To: java-user@lucene.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQkkodakoxwORA7zNuVpnlgMHaDCM7JoMyLc10AnJpSeKYLFLSnGYHA+D9dOJ0826Dodopvs X-Virus-Checked: Checked by ClamAV on apache.org Run CheckIndex on the index? What filesystem is IndexWriter using to write to the index...? Have you changed the LockFactory on the Directory? Mike McCandless http://blog.mikemccandless.com On Tue, Oct 30, 2012 at 11:27 PM, superruiye wrote: > The exception "read past EOF" Bothering me a long time, trace at below. > > > Exception in thread "Lucene Merge Thread #7" > org.apache.lucene.index.MergePolicy$MergeException: java.io.IOException: > read past EOF > at > org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:517) > at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) > Caused by: java.io.IOException: read past EOF > at > org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:207) > at > org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:39) > at org.apache.lucene.store.DataInput.readVInt(DataInput.java:105) > at > org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:181) > at > org.apache.lucene.index.SegmentTermPositions.readDeltaPosition(SegmentTermPositions.java:76) > at > org.apache.lucene.index.SegmentTermPositions.nextPosition(SegmentTermPositions.java:72) > at > org.apache.lucene.index.SegmentMerger.appendPostings(SegmentMerger.java:594) > at > org.apache.lucene.index.SegmentMerger.mergeTermInfos(SegmentMerger.java:538) > at > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:470) > at > org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:109) > at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4273) > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3917) > at > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:388) > at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:456) > > > in this time,it come in merge time,but it index successfully and I can > search the new index info.I use lucene 3.4.0,and some config in > IndexWriterConfig is: > indexWriterConfig.setMaxBufferedDocs(2000); > indexWriterConfig.setRAMBufferSizeMB(64); > > I used a PostponeCommitDeletionPolicy I rewrite ,and it delete the commit > after commits.get(i).getTimestamp 5 minutes. > > > > > -- > View this message in context: http://lucene.472066.n3.nabble.com/read-past-EOF-when-merge-tp4017179.html > Sent from the Lucene - Java Users mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org