hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: EndOfStreamException: Unable to read additional data from client
Date Wed, 17 Jul 2013 01:50:18 GMT
This scanner timeout is because your map task is taing to much time to
handle one single row. Or your server is to busy. Can you reduce the amount
of work done on your map task or split it in 2 tasks? How busy are your
servers when this occurs? Do you have the metrics?

JM

2013/7/16 puneetdabulya@gmail.com <puneetdabulya@gmail.com>

> On followup note. if I can hbase.zookeeper.property.maxClientCnxns to
> default
> value (I was using 1000), it start getting following exceptions in hadoop
> logs:
>
> 2013-07-16 21:38:28,584 INFO
> org.apache.hadoop.hbase.mapreduce.TableRecordReader: recovered from
> org.apache.hadoop.hbase.client.ScannerTimeoutException: 191864ms passed
> since the last invocation, timeout is currently set to 60000
>         at
> org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:283)
>         at
>
> org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:190)
>         at
>
> org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:135)
>         at
>
> com.ibm.viral.giraph.connectedcomponent.ConnectedComponentsInputFormat$GiraphTwitterHBaseVertexReader.nextVertex(ConnectedComponentsInputFormat.java:46)
>         at
>
> org.apache.giraph.io.internal.WrappedVertexReader.nextVertex(WrappedVertexReader.java:82)
>         at
>
> org.apache.giraph.worker.VertexInputSplitsCallable.readInputSplit(VertexInputSplitsCallable.java:147)
>         at
>
> org.apache.giraph.worker.InputSplitsCallable.loadInputSplit(InputSplitsCallable.java:267)
>         at
>
> org.apache.giraph.worker.InputSplitsCallable.call(InputSplitsCallable.java:211)
>         at
>
> org.apache.giraph.worker.InputSplitsCallable.call(InputSplitsCallable.java:60)
>         at
>
> org.apache.giraph.utils.LogStacktraceCallable.call(LogStacktraceCallable.java:51)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:679)
> Caused by: org.apache.hadoop.hbase.UnknownScannerException:
> org.apache.hadoop.hbase.UnknownScannerException: Name: -4371449348530597226
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2595)
>         at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source)
>         at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at
>
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:320)
>         at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
>
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at
>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
>         at
>
> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
>         at
>
> org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:143)
>         at
>
> org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:42)
>         at
>
> org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:164)
>         at
> org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:274)
>         ... 14 more
>
>
> This happens when at the same time, when zookeeper logs prints (I am
> tailing
> in parallel):
> EndOfStreamException: Unable to read additional data from client sessionid
> 0x13fea3a1e540030, likely client has closed socket
>         at
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>         at
>
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>         at java.lang.Thread.run(Thread.java:662)
> 2013-07-16 21:36:27,613 INFO org.apache.zookeeper.server.NIOServerCnxn:
> Closed socket connection for client /9.12.206.55:37226 which had sessionid
> 0x13fea3a1e540030
>
>
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/EndOfStreamException-Unable-to-read-additional-data-from-client-tp4048008p4048011.html
> Sent from the HBase User mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message