Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9CBCCF9ED for ; Wed, 10 Apr 2013 17:18:23 +0000 (UTC) Received: (qmail 67072 invoked by uid 500); 10 Apr 2013 17:18:23 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 67030 invoked by uid 500); 10 Apr 2013 17:18:23 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 67012 invoked by uid 99); 10 Apr 2013 17:18:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Apr 2013 17:18:22 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of enewman@integrity-apps.com designates 8.21.234.82 as permitted sender) Received: from [8.21.234.82] (HELO MX1.integrity-apps.com) (8.21.234.82) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Apr 2013 17:18:12 +0000 Received: from MX1.integrity-apps.com (localhost.localdomain [127.0.0.1]) by localhost (Email Security Appliance) with SMTP id 4F503C3709_1659EBFB for ; Wed, 10 Apr 2013 17:17:51 +0000 (GMT) Received: from chunex01.integrity-apps.com (unknown [172.25.1.12]) by MX1.integrity-apps.com (Sophos Email Appliance) with ESMTP id DD099C05EB_1659EBDF for ; Wed, 10 Apr 2013 17:17:49 +0000 (GMT) Received: from CHUNEX01.integrity-apps.com ([172.25.1.12]) by CHUNEX01.integrity-apps.com ([172.25.1.12]) with mapi id 14.01.0438.000; Wed, 10 Apr 2013 13:17:49 -0400 From: "Newman, Elise" To: "user@accumulo.apache.org" Subject: RE: java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly Thread-Topic: java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly Thread-Index: Ac42DjoCYVrT1Sv1RnmUrUQcDU78wAAIj1mAAAhRW9A= Date: Wed, 10 Apr 2013 17:17:49 +0000 Message-ID: <5F6CD32B82CED547BD2F906BC992127601453FBF@CHUNEX01.integrity-apps.com> References: <5F6CD32B82CED547BD2F906BC992127601453FA5@CHUNEX01.integrity-apps.com> <51659E17.5010707@gmail.com> In-Reply-To: <51659E17.5010707@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.210.116] Content-Type: multipart/alternative; boundary="_000_5F6CD32B82CED547BD2F906BC992127601453FBFCHUNEX01integri_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_5F6CD32B82CED547BD2F906BC992127601453FBFCHUNEX01integri_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable commons/lib contains commons-io-1.4.jar From: Josh Elser [mailto:josh.elser@gmail.com] Sent: Wednesday, April 10, 2013 10:15 AM To: user@accumulo.apache.org Subject: Re: java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.clo= seQuietly Elise, Looks like you're missing a commons-io dependency. Can you check lib and li= b/ext and report if you have a commons-io-*.jar present? On 4/10/13 1:10 PM, Newman, Elise wrote: I'm able to initialize and start Accumulo without any noticeable issues. Ev= erything looks okay for a while, except the warnings about system swappines= s being improperly set. After about ten minutes I see the following in my tserver_*.debug.logs: 2013-04-10 09:09:42,825 [tabletserver.TabletServer] WARN : exception while = scanning tablet !0;!0<< java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly(Lja= va/io/Closeable;)V at org.apache.hadoop.hdfs.DFSInputStream.getBlockReader(DFS= InputStream.java:986) at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInp= utStream.java:471) at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(D= FSInputStream.java:662) at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStrea= m.java:706) at java.io.DataInputStream.read(DataInputStream.java:132) at java.io.DataInputStream.readFully(DataInputStream.java:1= 78) at java.io.DataInputStream.readLong(DataInputStream.java:39= 9) at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Reader= .(BCFile.java:608) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.init(CachableBlockFile.java:246) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getBCFile(CachableBlockFile.java:257) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.access$000(CachableBlockFile.java:143) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader$MetaBlockLoader.get(CachableBlockFile.java:212) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getBlock(CachableBlockFile.java:313) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getMetaBlock(CachableBlockFile.java:367) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getMetaBlock(CachableBlockFile.java:143) at org.apache.accumulo.core.file.rfile.RFile$Reader.(= RFile.java:834) at org.apache.accumulo.core.file.rfile.RFileOperations.open= Reader(RFileOperations.java:79) at org.apache.accumulo.core.file.DispatchingFileFactory.ope= nReader(FileOperations.java:120) at org.apache.accumulo.server.tabletserver.FileManager.rese= rveReaders(FileManager.java:308) at org.apache.accumulo.server.tabletserver.FileManager.acce= ss$500(FileManager.java:55) at org.apache.accumulo.server.tabletserver.FileManager$Scan= FileManager.openFiles(FileManager.java:465) at org.apache.accumulo.server.tabletserver.FileManager$Scan= FileManager.openFiles(FileManager.java:473) at org.apache.accumulo.server.tabletserver.Tablet$ScanDataS= ource.createIterator(Tablet.java:2056) at org.apache.accumulo.server.tabletserver.Tablet$ScanDataS= ource.iterator(Tablet.java:2018) at org.apache.accumulo.core.iterators.system.SourceSwitchin= gIterator.seek(SourceSwitchingIterator.java:163) at org.apache.accumulo.server.tabletserver.Tablet.nextBatch= (Tablet.java:1735) at org.apache.accumulo.server.tabletserver.Tablet.access$32= 00(Tablet.java:152) at org.apache.accumulo.server.tabletserver.Tablet$Scanner.r= ead(Tablet.java:1875) at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler$NextBatchTask.run(TabletServer.java:943) at org.apache.accumulo.server.tabletserver.TabletServerReso= urceManager.executeReadAhead(TabletServerResourceManager.java:723) at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler.continueScan(TabletServer.java:1181) at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler.startScan(TabletServer.java:1150) at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Sour= ce) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati= ngMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.accumulo.trace.instrument.thrift.TraceWrap$1.= invoke(TraceWrap.java:63) at $Proxy10.startScan(Unknown Source) at org.apache.accumulo.core.tabletserver.thrift.TabletClien= tService$Processor$startScan.getResult(TabletClientService.java:1910) at org.apache.accumulo.core.tabletserver.thrift.TabletClien= tService$Processor$startScan.getResult(TabletClientService.java:1894) at org.apache.thrift.ProcessFunction.process(ProcessFunctio= n.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.= java:39) at org.apache.accumulo.server.util.TServerUtils$TimedProces= sor.process(TServerUtils.java:156) at org.apache.thrift.server.AbstractNonblockingServer$Frame= Buffer.invoke(AbstractNonblockingServer.java:478) at org.apache.accumulo.server.util.TServerUtils$THsHaServer= $Invocation.run(TServerUtils.java:208) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(T= hreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Threa= dPoolExecutor.java:908) at org.apache.accumulo.trace.instrument.TraceRunnable.run(T= raceRunnable.java:47) at org.apache.accumulo.core.util.LoggingRunnable.run(Loggin= gRunnable.java:34) at java.lang.Thread.run(Thread.java:662) 2013-04-10 09:09:42,833 [thrift.ProcessFunction] ERROR: Internal error proc= essing startScan java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.l= ang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/= Closeable;)V at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler.continueScan(TabletServer.java:1195) at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler.startScan(TabletServer.java:1150) at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Sour= ce) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati= ngMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.accumulo.trace.instrument.thrift.TraceWrap$1.= invoke(TraceWrap.java:63) at $Proxy10.startScan(Unknown Source) at org.apache.accumulo.core.tabletserver.thrift.TabletClien= tService$Processor$startScan.getResult(TabletClientService.java:1910) at org.apache.accumulo.core.tabletserver.thrift.TabletClien= tService$Processor$startScan.getResult(TabletClientService.java:1894) at org.apache.thrift.ProcessFunction.process(ProcessFunctio= n.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.= java:39) at org.apache.accumulo.server.util.TServerUtils$TimedProces= sor.process(TServerUtils.java:156) at org.apache.thrift.server.AbstractNonblockingServer$Frame= Buffer.invoke(AbstractNonblockingServer.java:478) at org.apache.accumulo.server.util.TServerUtils$THsHaServer= $Invocation.run(TServerUtils.java:208) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(T= hreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Threa= dPoolExecutor.java:908) at org.apache.accumulo.trace.instrument.TraceRunnable.run(T= raceRunnable.java:47) at org.apache.accumulo.core.util.LoggingRunnable.run(Loggin= gRunnable.java:34) at java.lang.Thread.run(Thread.java:662) Caused by: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodE= rror: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V at org.apache.accumulo.server.tabletserver.TabletServer$Sca= nTask.get(TabletServer.java:696) at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler.continueScan(TabletServer.java:1186) ... 18 more Caused by: java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.close= Quietly(Ljava/io/Closeable;)V at org.apache.hadoop.hdfs.DFSInputStream.getBlockReader(DFS= InputStream.java:986) at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInp= utStream.java:471) at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(D= FSInputStream.java:662) at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStrea= m.java:706) at java.io.DataInputStream.read(DataInputStream.java:132) at java.io.DataInputStream.readFully(DataInputStream.java:1= 78) at java.io.DataInputStream.readLong(DataInputStream.java:39= 9) at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Reader= .(BCFile.java:608) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.init(CachableBlockFile.java:246) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getBCFile(CachableBlockFile.java:257) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.access$000(CachableBlockFile.java:143) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader$MetaBlockLoader.get(CachableBlockFile.java:212) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getBlock(CachableBlockFile.java:313) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getMetaBlock(CachableBlockFile.java:367) at org.apache.accumulo.core.file.blockfile.impl.CachableBlo= ckFile$Reader.getMetaBlock(CachableBlockFile.java:143) at org.apache.accumulo.core.file.rfile.RFile$Reader.(= RFile.java:834) at org.apache.accumulo.core.file.rfile.RFileOperations.open= Reader(RFileOperations.java:79) at org.apache.accumulo.core.file.DispatchingFileFactory.ope= nReader(FileOperations.java:120) at org.apache.accumulo.server.tabletserver.FileManager.rese= rveReaders(FileManager.java:308) at org.apache.accumulo.server.tabletserver.FileManager.acce= ss$500(FileManager.java:55) at org.apache.accumulo.server.tabletserver.FileManager$Scan= FileManager.openFiles(FileManager.java:465) at org.apache.accumulo.server.tabletserver.FileManager$Scan= FileManager.openFiles(FileManager.java:473) at org.apache.accumulo.server.tabletserver.Tablet$ScanDataS= ource.createIterator(Tablet.java:2056) at org.apache.accumulo.server.tabletserver.Tablet$ScanDataS= ource.iterator(Tablet.java:2018) at org.apache.accumulo.core.iterators.system.SourceSwitchin= gIterator.seek(SourceSwitchingIterator.java:163) at org.apache.accumulo.server.tabletserver.Tablet.nextBatch= (Tablet.java:1735) at org.apache.accumulo.server.tabletserver.Tablet.access$32= 00(Tablet.java:152) at org.apache.accumulo.server.tabletserver.Tablet$Scanner.r= ead(Tablet.java:1875) at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler$NextBatchTask.run(TabletServer.java:943) at org.apache.accumulo.server.tabletserver.TabletServerReso= urceManager.executeReadAhead(TabletServerResourceManager.java:723) at org.apache.accumulo.server.tabletserver.TabletServer$Thr= iftClientHandler.continueScan(TabletServer.java:1181) ... 18 more These two repeat, intermittently. The NoSuchMethodError also causes warning= s with messages "exception while doing multi-scan" "internal error processi= ng startMultiScan" and "failed to get multiscan result." Any insight as to = why this would be happening would be greatly appreciated. Thanks! Elise --_000_5F6CD32B82CED547BD2F906BC992127601453FBFCHUNEX01integri_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

commons/lib contains c= ommons-io-1.4.jar

 

 

From: Josh Elser [mailto:josh.elser@gmail.com]
Sent: Wednesday, April 10, 2013 10:15 AM
To: user@accumulo.apache.org
Subject: Re: java.lang.NoSuchMethodError: org.apache.commons.io.IOUt= ils.closeQuietly

 

Elise,

Looks like you're missing a commons-io dependency. Can you check lib and li= b/ext and report if you have a commons-io-*.jar present?

On 4/10/13 1:10 PM, Newman, Elise wrote:<= /p>

I’m able to initialize and start Accumulo with= out any noticeable issues. Everything looks okay for a while, except the wa= rnings about system swappiness being improperly set.

 

After about ten minutes I see the following in my ts= erver_*.debug.logs:

 

2013-04-10 09:09:42= ,825 [tabletserver.TabletServer] WARN : exception while scanning tablet !0;= !0<<

java.lang.NoSuchMet= hodError: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V<= /span>

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.getBlockReader(DFSInputStre= am.java:986)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.= java:471)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputSt= ream.java:662)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:70= 6)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.io.DataInputStream.read(DataInputStream.java:132)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.io.DataInputStream.readFully(DataInputStream.java:178)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.io.DataInputStream.readLong(DataInputStream.java:399)=

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Reader.<init= >(BCFile.java:608)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.init(CachableBlockFile.java:246)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getBCFile(CachableBlockFile.java:257)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.access$000(CachableBlockFile.java:143)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader$MetaBlockLoader.get(CachableBlockFile.java:212)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getBlock(CachableBlockFile.java:313)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getMetaBlock(CachableBlockFile.java:367)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getMetaBlock(CachableBlockFile.java:143)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.rfile.RFile$Reader.<init>(RFi= le.java:834)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.rfile.RFileOperations.openReader(RF= ileOperations.java:79)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.DispatchingFileFactory.openReader(F= ileOperations.java:120)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager.reserveReader= s(FileManager.java:308)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager.access$500(Fi= leManager.java:55)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager$ScanFileManag= er.openFiles(FileManager.java:465)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager$ScanFileManag= er.openFiles(FileManager.java:473)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet$ScanDataSource.cre= ateIterator(Tablet.java:2056)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet$ScanDataSource.ite= rator(Tablet.java:2018)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.iterators.system.SourceSwitchingIterator= .seek(SourceSwitchingIterator.java:163)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet.nextBatch(Tablet.j= ava:1735)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet.access$3200(Tablet= .java:152)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet$Scanner.read(Table= t.java:1875)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler$NextBatchTask.run(TabletServer.java:943)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServerResourceManag= er.executeReadAhead(TabletServerResourceManager.java:723)=

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler.continueScan(TabletServer.java:1181)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler.startScan(TabletServer.java:1150)

   <= span class=3D"apple-tab-span">       &nb= sp;     at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)

   <= span class=3D"apple-tab-span">       &nb= sp;     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodA= ccessorImpl.java:25)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.lang.reflect.Method.invoke(Method.java:597)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.trace.instrument.thrift.TraceWrap$1.invoke(Tr= aceWrap.java:63)

   <= span class=3D"apple-tab-span">       &nb= sp;     at $Proxy10.startScan(Unknown Source)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$= Processor$startScan.getResult(TabletClientService.java:1910)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$= Processor$startScan.getResult(TabletClientService.java:1894)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39= )

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)<= /span>

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.util.TServerUtils$TimedProcessor.proce= ss(TServerUtils.java:156)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.in= voke(AbstractNonblockingServer.java:478)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.util.TServerUtils$THsHaServer$Invocati= on.run(TServerUtils.java:208)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPool= Executor.java:886)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExec= utor.java:908)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunna= ble.java:47)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable= .java:34)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.lang.Thread.run(Thread.java:662)

2013-04-10 09:09:42= ,833 [thrift.ProcessFunction] ERROR: Internal error processing startScan

java.lang.RuntimeEx= ception: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodErr= or: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V=

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler.continueScan(TabletServer.java:1195)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler.startScan(TabletServer.java:1150)

   <= span class=3D"apple-tab-span">       &nb= sp;     at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)

   <= span class=3D"apple-tab-span">       &nb= sp;     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodA= ccessorImpl.java:25)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.lang.reflect.Method.invoke(Method.java:597)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.trace.instrument.thrift.TraceWrap$1.invoke(Tr= aceWrap.java:63)

   <= span class=3D"apple-tab-span">       &nb= sp;     at $Proxy10.startScan(Unknown Source)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$= Processor$startScan.getResult(TabletClientService.java:1910)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$= Processor$startScan.getResult(TabletClientService.java:1894)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39= )

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)<= /span>

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.util.TServerUtils$TimedProcessor.proce= ss(TServerUtils.java:156)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.in= voke(AbstractNonblockingServer.java:478)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.util.TServerUtils$THsHaServer$Invocati= on.run(TServerUtils.java:208)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPool= Executor.java:886)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExec= utor.java:908)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunna= ble.java:47)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable= .java:34)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.lang.Thread.run(Thread.java:662)

Caused by: java.uti= l.concurrent.ExecutionException: java.lang.NoSuchMethodError: org.apache.co= mmons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ScanTask.get= (TabletServer.java:696)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler.continueScan(TabletServer.java:1186)

   <= span class=3D"apple-tab-span">       &nb= sp;     ... 18 more

Caused by: java.lan= g.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Cl= oseable;)V

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.getBlockReader(DFSInputStre= am.java:986)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.= java:471)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputSt= ream.java:662)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:70= 6)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.io.DataInputStream.read(DataInputStream.java:132)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.io.DataInputStream.readFully(DataInputStream.java:178)

   <= span class=3D"apple-tab-span">       &nb= sp;     at java.io.DataInputStream.readLong(DataInputStream.java:399)=

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Reader.<init= >(BCFile.java:608)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.init(CachableBlockFile.java:246)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getBCFile(CachableBlockFile.java:257)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.access$000(CachableBlockFile.java:143)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader$MetaBlockLoader.get(CachableBlockFile.java:212)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getBlock(CachableBlockFile.java:313)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getMetaBlock(CachableBlockFile.java:367)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$Re= ader.getMetaBlock(CachableBlockFile.java:143)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.rfile.RFile$Reader.<init>(RFi= le.java:834)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.rfile.RFileOperations.openReader(RF= ileOperations.java:79)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.file.DispatchingFileFactory.openReader(F= ileOperations.java:120)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager.reserveReader= s(FileManager.java:308)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager.access$500(Fi= leManager.java:55)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager$ScanFileManag= er.openFiles(FileManager.java:465)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.FileManager$ScanFileManag= er.openFiles(FileManager.java:473)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet$ScanDataSource.cre= ateIterator(Tablet.java:2056)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet$ScanDataSource.ite= rator(Tablet.java:2018)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.core.iterators.system.SourceSwitchingIterator= .seek(SourceSwitchingIterator.java:163)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet.nextBatch(Tablet.j= ava:1735)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet.access$3200(Tablet= .java:152)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.Tablet$Scanner.read(Table= t.java:1875)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler$NextBatchTask.run(TabletServer.java:943)

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServerResourceManag= er.executeReadAhead(TabletServerResourceManager.java:723)=

   <= span class=3D"apple-tab-span">       &nb= sp;     at org.apache.accumulo.server.tabletserver.TabletServer$ThriftClient= Handler.continueScan(TabletServer.java:1181)

   <= span class=3D"apple-tab-span">       &nb= sp;     ... 18 more

 

These two repeat, intermittently. The NoSuchMethodEr= ror also causes warnings with messages “exception while doing multi-s= can” “internal error processing startMultiScan” and ̶= 0;failed to get multiscan result.” Any insight as to why this would be happening would be greatly appreciated.

 

Thanks!

Elise

 

 

--_000_5F6CD32B82CED547BD2F906BC992127601453FBFCHUNEX01integri_--