incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Samuel Guo" <guosi...@gmail.com>
Subject Re: UnknownScannerException
Date Tue, 04 Nov 2008 03:33:09 GMT
what size of matrix you used to run matrix-matrix mult?

On Tue, Nov 4, 2008 at 11:21 AM, Edward J. Yoon <edwardyoon@apache.org>wrote:

> Hmm... Yes, probably.
> Current mult algorithm needs one full scan by each rows (n). If it
> replaced to 2D blocking algorithm, it'll be solved.
>
> /Ed
>
> On Tue, Nov 4, 2008 at 12:07 PM, Samuel Guo <guosijie@gmail.com> wrote:
> > On Tue, Nov 4, 2008 at 10:30 AM, Edward J. Yoon <edwardyoon@apache.org
> >wrote:
> >
> >> While matrix-matrix mult, I received a message as below. Does anyone
> >> know about UnknownScannerException?
> >>
> >> ----
> >> 08/11/04 11:24:57 INFO mapred.JobClient:  map 90% reduce 28%
> >> 08/11/04 11:24:59 INFO mapred.JobClient:  map 90% reduce 30%
> >> 08/11/04 11:26:49 INFO mapred.JobClient: Task Id :
> >> attempt_200811041040_0003_m_000002_0, Status : FAILED
> >> org.apache.hadoop.hbase.UnknownScannerException:
> >> org.apache.hadoop.hbase.UnknownScannerException: Name:
> >> -1151932123796109789
> >>        at
> >>
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:1077)
> >>        at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> >>        at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>        at java.lang.reflect.Method.invoke(Method.java:597)
> >>        at
> >> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
> >>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
> >>
> >>        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> >> Method)
> >>        at
> >>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> >>        at
> >>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> >>        at
> java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> >>        at
> >>
> org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
> >>        at
> >>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:856)
> >
> >
> > I doubt that there may be some region splitting/moving during scanning,
> so
> > we get the RemoteException while getRegionServerWithRetires.
> >
> >
> >>
> >>        at
> >>
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1155)
> >>        at
> >>
> org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:174)
> >>        at
> >>
> org.apache.hama.mapred.MatrixInputFormatBase$TableRecordReader.next(MatrixInputFormatBase.java:56)
> >>        at
> >>
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:165)
> >>        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
> >>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
> >>        at
> >> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
> >>
> >> 08/11/04 11:27:11 INFO mapred.JobClient:  map 100% reduce 30%
> >> 08/11/04 11:27:17 INFO mapred.JobClient:  map 100% reduce 64%
> >> 08/11/04 11:27:23 INFO mapred.JobClient: Job complete:
> >> job_200811041040_0003
> >> 08/11/04 11:27:23 INFO mapred.JobClient: Counters: 13
> >> 08/11/04 11:27:23 INFO mapred.JobClient:   File Systems
> >> 08/11/04 11:27:23 INFO mapred.JobClient:     Local bytes read=32057196
> >> 08/11/04 11:27:23 INFO mapred.JobClient:     Local bytes
> written=64599524
> >>
> >> --
> >> Best regards, Edward J. Yoon @ NHN, corp.
> >> edwardyoon@apache.org
> >> http://blog.udanax.org
> >>
> >
>
>
>
> --
> Best regards, Edward J. Yoon @ NHN, corp.
> edwardyoon@apache.org
> http://blog.udanax.org
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message