From dev-return-343803-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Thu Dec 27 07:18:54 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 6F8C418077A for ; Thu, 27 Dec 2018 07:18:53 +0100 (CET) Received: (qmail 96918 invoked by uid 500); 27 Dec 2018 06:18:52 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 96824 invoked by uid 99); 27 Dec 2018 06:18:51 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Dec 2018 06:18:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id EA736C02F1 for ; Thu, 27 Dec 2018 06:18:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.048 X-Spam-Level: ** X-Spam-Status: No, score=2.048 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Pab3pRzf9P7d for ; Thu, 27 Dec 2018 06:18:49 +0000 (UTC) Received: from mail-pf1-f169.google.com (mail-pf1-f169.google.com [209.85.210.169]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id B07455F20B for ; Thu, 27 Dec 2018 06:18:49 +0000 (UTC) Received: by mail-pf1-f169.google.com with SMTP id c73so8732617pfe.13 for ; Wed, 26 Dec 2018 22:18:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=jHzA9bf0CkZd7iYmbbaGSmX3AJ80zY9ZWieWMVcbOhE=; b=uum/RiaDjzYtf8BbbZ38yl0uvna38dCAbUjnoymi8K2j3KgL58687Tw/FFlhroJBpX 1DMeEa3AILAkwN49sZxpM15mQEe8dF03DHIVGaHZjD1EuBqmh/PtHkeK2v4tcgWbTpCG O0WhBrvansdsfi3b1u9MkZuUeenKDcyh4NwuozhITNEfpCw+uhwhS5yFEVLAQMzZmsnJ JFiU7nqRAkucOboFwy47+9on2HjkC8UbWoLeAwBeoXmheRji7BLZK2kUkFVSLIWWq0Xt NBK/lwR3r4vjbVZ5HDO5mBLbWFxHSs9OQVdfZU4FZblodiik0lxtx06oGCnZT826lf87 SCpw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=jHzA9bf0CkZd7iYmbbaGSmX3AJ80zY9ZWieWMVcbOhE=; b=a7j2Cc3VY25V666aQhsD4k5MVenk9TsBhcuN/jqD+n+xSKrOEezOEjcYrjwZmHKmeF 55d7pkbJUZ97uak0JnuteAOAhcdtbyJk+RVLfDYAINXtWUaV95N90Wvz+pKH5fpjBn46 5uPlwRapA4buqhQ2xqVU6UEnJ1P1euL1mzvhW/5zL+tL4gV9crxBSsFqSOiti82dMZbL RKnLRjESGIP9YmRPmz5kk42RBpXkFJR/P+0M7wWwK64Jg/8cYE1fY8pSuMfvMs7ZV7vO ha1gyhzalzcy/G6w5TSN7ZH2iPs18X/jZ4EhTuHpPvNoteJgq0+VpemP8LNujRAM6o6S 28oQ== X-Gm-Message-State: AA+aEWa0N4LlSoitdtcSrqW1v9H0KAibMraRdRRGSFZsO+fw8BtwWowe 9bEe66Lr0IBpgf2AmoUw6jzH6DyMiuSth3lEqRxOA+LO X-Google-Smtp-Source: ALg8bN4SmhTxRa3PwQ9Q1pqdrHLHbpPABiUW095dgdkwkSe4gh0Zyl9j93wIKfT7tayZwsO0tzsiittHGvf2BsqziQQ= X-Received: by 2002:a62:9111:: with SMTP id l17mr22902976pfe.200.1545891523412; Wed, 26 Dec 2018 22:18:43 -0800 (PST) MIME-Version: 1.0 From: John Wilson Date: Wed, 26 Dec 2018 22:18:32 -0800 Message-ID: Subject: ByteBuffersDirectory throws Exception To: dev@lucene.apache.org Content-Type: multipart/alternative; boundary="0000000000001d46fd057dfaeb6f" --0000000000001d46fd057dfaeb6f Content-Type: text/plain; charset="UTF-8" Hi, I'm getting the below error message while running a simple multi-threaded indexing using ByteBuffersDirectory. Any suggestions? Exception in thread "Lucene Merge Thread #879" org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:705) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:685) Caused by: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception at org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:349) at org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:669) at org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:664) at org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:5024) at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4539) at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4075) at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:626) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:663) Caused by: java.lang.IllegalArgumentException: cannot write negative vLong (got: -4294878395) at org.apache.lucene.store.DataOutput.writeVLong(DataOutput.java:225) at org.apache.lucene.codecs.lucene50.Lucene50SkipWriter.writeSkipData(Lucene50SkipWriter.java:180) at org.apache.lucene.codecs.MultiLevelSkipListWriter.bufferSkip(MultiLevelSkipListWriter.java:143) at org.apache.lucene.codecs.lucene50.Lucene50SkipWriter.bufferSkip(Lucene50SkipWriter.java:162) at org.apache.lucene.codecs.lucene50.Lucene50PostingsWriter.startDoc(Lucene50PostingsWriter.java:228) at org.apache.lucene.codecs.PushPostingsWriterBase.writeTerm(PushPostingsWriterBase.java:148) at org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsWriter.java:865) at org.apache.lucene.codecs.blocktree.BlockTreeTermsWriter.write(BlockTreeTermsWriter.java:344) at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105) at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsFormat.java:169) at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:244) at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:139) at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4453) ... 3 more --0000000000001d46fd057dfaeb6f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,

I'm getting th= e below error=C2=A0message while running a simple multi-threaded indexing u= sing ByteBuffersDirectory. Any=C2=A0suggestions?

<= div>Exception in thread "Lucene Me= rge Thread #879" org.apache.lucene.index.MergePolicy$MergeException: o= rg.apache.lucene.store.AlreadyClosedException: refusing to delete any files= : this IndexWriter hit an unrecoverable exception
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucen= e.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeSchedu= ler.java:705)
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.index.ConcurrentMergeScheduler$Me= rgeThread.run(ConcurrentMergeScheduler.java:685)
Caused by: org.apache.lucene.store.AlreadyClosed= Exception: refusing to delete any files: this IndexWriter hit an unrecovera= ble exception
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.index.IndexFileDeleter.ensureOpen= (IndexFileDeleter.java:349)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.index.IndexFileDelet= er.deleteFiles(IndexFileDeleter.java:669)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.index.= IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:664)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apa= che.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:5024)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at= org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4539)
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4075)
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentM= ergeScheduler.java:626)
Caused by: java.lang.IllegalArgumentExc= eption: cannot write negative vLong (got: -4294878395)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.= lucene.store.DataOutput.writeVLong(DataOutput.java:225)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache= .lucene.codecs.lucene50.Lucene50SkipWriter.writeSkipData(Lucene50SkipWriter= .java:180)
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 at org.apache.lucene.codecs.MultiLevelSkipListWriter.buff= erSkip(MultiLevelSkipListWriter.java:143)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.codecs= .lucene50.Lucene50SkipWriter.bufferSkip(Lucene50SkipWriter.java:162)=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 = at org.apache.lucene.codecs.lucene50.Lucene50PostingsWriter.startDoc(Lucene= 50PostingsWriter.java:228)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.codecs.PushPostingsWr= iterBase.writeTerm(PushPostingsWriterBase.java:148)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.luc= ene.codecs.blocktree.BlockTreeTermsWriter$TermsWriter.write(BlockTreeTermsW= riter.java:865)
=C2=A0= =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.codecs.blocktree.BlockTreeTermsW= riter.write(BlockTreeTermsWriter.java:344)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.codec= s.FieldsConsumer.merge(FieldsConsumer.java:105)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.= codecs.perfield.PerFieldPostingsFormat$FieldsWriter.merge(PerFieldPostingsF= ormat.java:169)
=C2=A0= =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.index.SegmentMerger.mergeTerms(S= egmentMerger.java:244)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.index.SegmentMerger.merge= (SegmentMerger.java:139)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.lucene.index.IndexWriter.merge= Middle(IndexWriter.java:4453)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ... 3 more

<= /div>
--0000000000001d46fd057dfaeb6f--