hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From stack <st...@duboce.net>
Subject Re: Unknown kind of exception.
Date Mon, 18 Feb 2008 16:39:58 GMT
edward yoon wrote:
> Hmm. I see.
>
> Now i see the 165 line at TableInputFormat.
> Can map number be operated with a setNumMapTasks() method?
> What is the current split policy?
>   
See how the method at line 165 makes a split per region found.

See JobClient #575 inside submitJobs.  Looks like it sets number of maps 
to be splits.length.

St.Ack




> On 2/18/08, stack <stack@duboce.net> wrote:
>   
>> Probably that the lease expired on the scanner your map or reduce task
>> was using.  Any other exceptions in the log or does the processing of
>> the data to put into hbase take a long time to do?
>> St.Ack
>>
>> edward yoon wrote:
>>     
>>> I tried scan a 1 thousand * 1 thousand table twice on mapreduce.
>>> BTW, What is this exception mean?
>>>
>>> ----
>>> 08/02/18 11:34:53 INFO mapred.JobClient: Task Id :
>>> task_200802181109_0002_m_000000_1, Status : FAILED
>>> org.apache.hadoop.hbase.UnknownScannerException:
>>> org.apache.hadoop.hbase.UnknownScannerException: -4925937627020823950
>>>         at org.apache.hadoop.hbase.HRegionServer.close(HRegionServer.java:1543)
>>>         at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
>>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>>         at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
>>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:910)
>>>
>>>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>>> Method)        at
>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>>>         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>>>         at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>>>         at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
>>>         at org.apache.hadoop.hbase.HTable$ClientScanner.close(HTable.java:1169)
>>>         at org.apache.hadoop.hama.mapred.TableInputFormat$TableRecordReader.close(Unknown
>>> Source)
>>>         at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.close(MapTask.java:155)
>>>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:212)
>>>         at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2065)
>>>
>>>
>>>       
>>     
>
>
>   


Mime
View raw message