incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: UnknownScannerException
Date Tue, 04 Nov 2008 03:21:31 GMT
Hmm... Yes, probably.
Current mult algorithm needs one full scan by each rows (n). If it
replaced to 2D blocking algorithm, it'll be solved.

/Ed

On Tue, Nov 4, 2008 at 12:07 PM, Samuel Guo <guosijie@gmail.com> wrote:
> On Tue, Nov 4, 2008 at 10:30 AM, Edward J. Yoon <edwardyoon@apache.org>wrote:
>
>> While matrix-matrix mult, I received a message as below. Does anyone
>> know about UnknownScannerException?
>>
>> ----
>> 08/11/04 11:24:57 INFO mapred.JobClient:  map 90% reduce 28%
>> 08/11/04 11:24:59 INFO mapred.JobClient:  map 90% reduce 30%
>> 08/11/04 11:26:49 INFO mapred.JobClient: Task Id :
>> attempt_200811041040_0003_m_000002_0, Status : FAILED
>> org.apache.hadoop.hbase.UnknownScannerException:
>> org.apache.hadoop.hbase.UnknownScannerException: Name:
>> -1151932123796109789
>>        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077)
>>        at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
>>        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>        at java.lang.reflect.Method.invoke(Method.java:597)
>>        at
>> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
>>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>>
>>        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>> Method)
>>        at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>>        at
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>>        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>>        at
>> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
>>        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856)
>
>
> I doubt that there may be some region splitting/moving during scanning, so
> we get the RemoteException while getRegionServerWithRetires.
>
>
>>
>>        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155)
>>        at
>> org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:174)
>>        at
>> org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:56)
>>        at
>> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165)
>>        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
>>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
>>        at
>> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
>>
>> 08/11/04 11:27:11 INFO mapred.JobClient:  map 100% reduce 30%
>> 08/11/04 11:27:17 INFO mapred.JobClient:  map 100% reduce 64%
>> 08/11/04 11:27:23 INFO mapred.JobClient: Job complete:
>> job_200811041040_0003
>> 08/11/04 11:27:23 INFO mapred.JobClient: Counters: 13
>> 08/11/04 11:27:23 INFO mapred.JobClient:   File Systems
>> 08/11/04 11:27:23 INFO mapred.JobClient:     Local bytes read=32057196
>> 08/11/04 11:27:23 INFO mapred.JobClient:     Local bytes written=64599524
>>
>> --
>> Best regards, Edward J. Yoon @ NHN, corp.
>> edwardyoon@apache.org
>> http://blog.udanax.org
>>
>



-- 
Best regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org

Mime
View raw message