Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 294CF1071D for ; Wed, 20 Nov 2013 00:38:39 +0000 (UTC) Received: (qmail 8809 invoked by uid 500); 20 Nov 2013 00:38:39 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 8694 invoked by uid 500); 20 Nov 2013 00:38:38 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 8686 invoked by uid 99); 20 Nov 2013 00:38:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Nov 2013 00:38:38 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS,UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [129.55.12.46] (HELO mx2.ll.mit.edu) (129.55.12.46) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Nov 2013 00:38:31 +0000 Received: from LLE2K7-HUB02.mitll.ad.local (LLE2K7-HUB02.mitll.ad.local) by mx2.ll.mit.edu (unknown) with ESMTP id rAK0cA9s027022 for ; Tue, 19 Nov 2013 19:38:10 -0500 From: "Tran, An - 0553 - MITLL" To: "user@accumulo.apache.org" Date: Tue, 19 Nov 2013 19:38:07 -0500 Subject: TabletServerBatchReaderIterator Java heap space errors Thread-Topic: TabletServerBatchReaderIterator Java heap space errors Thread-Index: Ac7liMkHN7MyLSldQvai17abrVkyuQ== Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.3.8.130913 acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CEB16E9F32E0atranllmitedu_" MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.10.8794,1.0.14,0.0.0000 definitions=2013-11-19_08:2013-11-19,2013-11-19,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 suspectscore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=7.0.1-1305240000 definitions=main-1311190195 X-Virus-Checked: Checked by ClamAV on apache.org --_000_CEB16E9F32E0atranllmitedu_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I am currently getting TabletServerBatchReaderIterator Java heap space err= ors. Below are the log outputs. Do any of you know what is going on and w= hat is the proper solution to fix this issue? A little detail on the use case is I have an application which uses a threa= d pool that does concurrent queries on Accumulo. Any insight on this issue= is greatly appreciated . Thanks. 19 Nov 2013 14:13:06,845 52142 [batch scanner 7-7 looking up 4 ranges at 19= 2.168.1.66:9997] WARN TabletServerBatchReaderIterator run Java heap space java.lang.OutOfMemoryError: Java heap space 19 Nov 2013 14:13:06,845 52142 [batch scanner 7-6 looking up 5 ranges at 19= 2.168.1.68:9997] WARN TabletServerBatchReaderIterator run Java heap space java.lang.OutOfMemoryError: Java heap space 19 Nov 2013 14:13:06,844 52141 [batch scanner 7-3 looking up 3 ranges at 19= 2.168.1.69:9997] WARN TabletServerBatchReaderIterator run Java heap space java.lang.OutOfMemoryError: Java heap space 19 Nov 2013 14:13:06,844 52141 [batch scanner 7-2 looking up 3 ranges at 19= 2.168.1.63:9997] WARN TabletServerBatchReaderIterator run Java heap space java.lang.OutOfMemoryError: Java heap space 19 Nov 2013 14:13:06,843 52140 [batch scanner 6-1 looking up 5 ranges at 19= 2.168.1.67:9997] WARN TabletServerBatchReaderIterator run Java heap space java.lang.OutOfMemoryError: Java heap space 19 Nov 2013 14:13:06,846 52143 [batch scanner 7-4 looking up 7 ranges at 19= 2.168.1.67:9997] WARN TabletServerBatchReaderIterator run Java heap space java.lang.OutOfMemoryError: Java heap space 19 Nov 2013 14:13:06,846 52143 [batch scanner 6-3 looking up 5 ranges at 19= 2.168.1.64:9997] WARN TabletServerBatchReaderIterator run Java heap space ava.lang.OutOfMemoryError: Java heap space at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doL= ookup(TabletServerBatchReaderIterator.java:564) at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$Que= ryTask.run(TabletServerBatchReaderIterator.java:338) at org.apache.accumulo.cloudtrace.instrument.TraceRunnable.run(TraceRunnabl= e.java:47) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav= a:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja= va:615) at java.lang.Thread.run(Thread.java:724) java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOfRange(Arrays.java:2550) at org.apache.accumulo.core.util.ByteBufferUtil.toBytes(ByteBufferUtil.java= :31) at org.apache.accumulo.core.data.Key.(Key.java:288) at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doL= ookup(TabletServerBatchReaderIterator.java:564) at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$Que= ryTask.run(TabletServerBatchReaderIterator.java:338) at org.apache.accumulo.cloudtrace.instrument.TraceRunnable.run(TraceRunnabl= e.java:47) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.jav= a:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja= va:615) at java.lang.Thread.run(Thread.java:724) --_000_CEB16E9F32E0atranllmitedu_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
Hi,

I am currently getting TabletServerBatchReaderIterator&n= bsp; Java heap space errors.  Below are the log outputs.&nbs= p; Do any of you know what is going on and what is the proper solution= to fix this issue?
A little detail on the use case is I have an application which uses= a thread pool that does concurrent queries on Accumulo.  Any ins= ight on this issue is greatly appreciated .

Thanks.

19 Nov 2013 14:13:06,845 52142 [batch scanner 7-7 looking up = 4 ranges at 192.168.1.66:9997] WARN  TabletServerBatchReaderItera= tor run
&nbs= p;          Java heap space
java.lang.OutO= fMemoryError: Java heap space
19 Nov 2013 14:13:06,845 52142 [batch scanner 7-6 looking= up 5 ranges at 192.168.1.68:9997] WARN  TabletServerBatchReaderI= terator run
=            Java heap spac= e
java.lang.= OutOfMemoryError: Java heap space
19 Nov 2013 14:13:06,844 52141 [batch scanner 7-3 loo= king up 3 ranges at 192.168.1.69:9997] WARN  TabletServerBatchRea= derIterator run
           Java heap = space
java.l= ang.OutOfMemoryError: Java heap space
19 Nov 2013 14:13:06,844 52141 [batch scanner 7-2= looking up 3 ranges at 192.168.1.63:9997] WARN  TabletServerBatc= hReaderIterator run
           Java h= eap space
ja= va.lang.OutOfMemoryError: Java heap space
19 Nov 2013 14:13:06,843 52140 [batch scanner= 6-1 looking up 5 ranges at 192.168.1.67:9997] WARN  TabletServer= BatchReaderIterator run
           Ja= va heap space
19 Nov 2013 14:13:06,846 52143 [batch sca= nner 7-4 looking up 7 ranges at 192.168.1.67:9997] WARN  TabletSe= rverBatchReaderIterator run
          = ; Java heap space
java.lang.OutOfMemoryError: Java heap space
19 Nov 2013 14:13:06,846 52143 [batch= scanner 6-3 looking up 5 ranges at 192.168.1.64:9997] WARN  Tabl= etServerBatchReaderIterator run
         &= nbsp; Java heap space
ava.lang.OutOfMemoryError: Java heap space
at org.apache.accumulo.core.client= .impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderItera= tor.java:564)
at org.apache.accumulo.cloudtrac= e.instrument.TraceRunnable.run(TraceRunnable.java:47)
at java.util.concurrent.ThreadPoo= lExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExe= cutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)<= /div>
java.la= ng.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays= .java:2550)
at org.apache.accumulo.core.util.ByteBufferUtil.toBytes(ByteBuf= ferUtil.java:31)
at org.apache.accumulo.core.data.Key.<init>(Key.java= :288)
<= /span>at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterat= or.doLookup(TabletServerBatchReaderIterator.java:564)
at org.apache.accumul= o.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServ= erBatchReaderIterator.java:338)
at org.apache.accumulo.cloudtrace.instrumen= t.TraceRunnable.run(TraceRunnable.java:47)
at java.util.concurrent.ThreadPo= olExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.= ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thr= ead.run(Thread.java:724)

--_000_CEB16E9F32E0atranllmitedu_--