Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of duke.dai.007@gmail.com
 designates 209.85.215.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAL8PwkaBd0miN-vKcCPpYHt+fQfuDxs74At6R4vkSXXUts1y9A@mail.gmail.com>
References: 
 <CAPYoNwerH3wnqz7YAGZ5ixKQ8NY7agPZEA_DB4t49uvJGr6g2A@mail.gmail.com>
	<CAL8Pwkb32KbGbuz5XvzwZkJrNOoyKZw7iAOW3d6AO3JYuHwBmQ@mail.gmail.com>
	<CAPYoNwesZM2pZfY=iOb8tB7vfkO2xr-xG7CXUd55NpTsPV3Akw@mail.gmail.com>
	<CAL8PwkaBd0miN-vKcCPpYHt+fQfuDxs74At6R4vkSXXUts1y9A@mail.gmail.com>
Date: Thu, 19 Jan 2012 22:19:02 +0800
Message-ID: 
 <CAPYoNwc8pTknq8By5OA8307HEpJHHmv-VYx=Htnk56bDp9=AYQ@mail.gmail.com>
Subject: Re: ArrayIndexOutOfBoundsException: -65536
From: Duke DAI <duke.dai.007@gmail.com>
To: Michael McCandless <lucene@mikemccandless.com>
Cc: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=f46d040169cffc361904b6e23e9b

--f46d040169cffc361904b6e23e9b
Content-Type: text/plain; charset=UTF-8

Dear Mike,
Yes, it's possible that the document is bigger enough after original PDF
has been processed to intermediate one. I'm trying to make sure it from
customer.
I can't produce with the same PDF on in-house system, but the component
translating PDF to intermediate file can be different.

What kind of hardware issue can cause AIOOBE? Is there any possible?


Best regards,
Duke
If not now, when? If not me, who?


On Wed, Jan 18, 2012 at 9:47 PM, Michael McCandless <
lucene@mikemccandless.com> wrote:

> Hmm, are you certain your RAM buffer is 3 MB?
>
> Is it possible you are indexing an absurdly enormous document...?
>
> Finally, it's possible this is a hardware issue; does it happen on
> other machines?
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
> On Wed, Jan 18, 2012 at 8:15 AM, Duke DAI <duke.dai.007@gmail.com> wrote:
> > Dear Mike,
> > Thank you very much and sorry for the late reply.
> >
> > Followings are the trace stack, the lucene code line is 3.0.3. From line
> > numbers, lucene is adding payload field to the buffer. This had been
> tested
> > millions of times in various customers and internally. But recently the
> > exception happened on one system without access by me. When using those
> > documents who triggered the exception in a similar system, I just can't
> > reproduce. I hope you can retrospect something from the limited
> > information.
> >
> > Caused by: java.lang.ArrayIndexOutOfBoundsException: -65536
> > at
> >
> org.apache.lucene.index.TermsHashPerField.writeByte(TermsHashPerField.java:480)
> > at
> >
> org.apache.lucene.index.TermsHashPerField.writeVInt(TermsHashPerField.java:506)
> > at
> >
> org.apache.lucene.index.FreqProxTermsWriterPerField.writeProx(FreqProxTermsWriterPerField.java:99)
> > at
> >
> org.apache.lucene.index.FreqProxTermsWriterPerField.addTerm(FreqProxTermsWriterPerField.java:160)
> > at
> org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:468)
> > at
> >
> org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:174)
> > at
> >
> org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:246)
> > at
> >
> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:826)
> > at
> >
> org.apache.lucene.index.DocumentsWriter.addDocument(DocumentsWriter.java:802)
> > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1998)
> > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1972)
> >         ...
> >        (following are business related method stack and also had been
> > obfuscated)
> >
> > Best regards,
> > Duke
> > If not now, when? If not me, who?
> > M 13818420095
> >
> >
> >
> > On Mon, Jan 16, 2012 at 9:09 AM, Michael McCandless
> > <lucene@mikemccandless.com> wrote:
> >>
> >> Do you have a full traceback of the exception?
> >>
> >> Mike McCandless
> >>
> >> http://blog.mikemccandless.com
> >>
> >> On Sun, Jan 15, 2012 at 7:21 PM, Duke DAI <duke.dai.007@gmail.com>
> wrote:
> >> > Hi friends,
> >> > Any one meet ArrayIndexOutOfBoundsException: -65536 described in
> >> > https://issues.apache.org/jira/browse/LUCENE-1995 after it declared
> >> > being
> >> > fixed?
> >> > My lucene version is 3.0.3 and MaxRAMBufferSize is 3M. All other
> >> > configurations seem to be normal.
> >> > It's hard to describe the environment and debug the system(which is
> >> > invisible for me). But by code reviewing and the explanation of
> >> > LUCENE-1995, only when the offset of byte array is Integer.MAX_VALUE
> the
> >> > exception will happen. Now I think there is no chance to cause it.
> >> >
> >> > Anyone has met the same issue and any hint or experience is
> appreciated.
> >> >
> >> > Best regards,
> >> > Duke
> >> > If not now, when? If not me, who?
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >>
> >
>

--f46d040169cffc361904b6e23e9b--