hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Dagaev" <michael.dag...@gmail.com>
Subject Re: Hbase Client Failure
Date Tue, 09 Dec 2008 13:29:13 GMT
Yoav,
   I believe this is our fault. Looks like that happened because the
Hadoop name node was not shut down properly.
M.

On Tue, Dec 9, 2008 at 2:42 PM, yoav.morag <yoav@corrigon.com> wrote:
>
> I had a similiar case with 0.17 where adding a delay between hadoop startup
> and hbase startup helped (essentially waiting for hadoop to get out of safe
> mode, I think)  .
> however when I last tried to restart 0.18 I got the same mesage as you - I
> did not try yet with delay.
>
>
> Michael Dagaev wrote:
>>
>> Hi, all
>>
>>     After Hbase (0.18.1) restart our client failed with an IO
>> Exception  -- Could not obtain block: blk_-6097614652807114983_50488
>> file=/hbase/-ROOT-/70236052/info/mapfiles/6743958588342007607/data.
>> (see the full trace below). The hbase shell failed with an exception
>> too.
>>
>> Do you know what can be the root cause of the exception?
>>
>> Thank you for your cooperation,
>> M.
>>
>> P.S. The exception stack:
>>
>> Caused by: java.io.IOException: java.io.IOException: Could not obtain
>> block: blk_-6097614652807114983_50488
>> file=/hbase/-ROOT-/70236052/info/mapfiles/6743958588342007607/data
>>         at
>> org.apache.hadoop.dfs.DFSClient$DFSInputStream.chooseDataNode(DFSClient.java:1462)
>>         at
>> org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:1312)
>>         at
>> org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:1417)
>>         at
>> org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:1369)
>>         at java.io.DataInputStream.readInt(DataInputStream.java:370)
>>         at
>> org.apache.hadoop.io.SequenceFile$Reader.readRecordLength(SequenceFile.java:1898)
>>         at
>> org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1928)
>>         at
>> org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1833)
>>         at
>> org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1879)
>>         at org.apache.hadoop.io.MapFile$Reader.next(MapFile.java:516)
>>         at
>> org.apache.hadoop.hbase.regionserver.HStore.rowAtOrBeforeFromMapFile(HStore.java:1504)
>>         at
>> org.apache.hadoop.hbase.regionserver.HStore.getRowKeyAtOrBefore(HStore.java:1476)
>>         at
>> org.apache.hadoop.hbase.regionserver.HRegion.getClosestRowBefore(HRegion.java:1250)
>>         at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getClosestRowBefore(HRegionServer.java:1062)
>>         at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>         at
>> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554)
>>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Hbase-Client-Failure-tp20913340p20913975.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
>

Mime
View raw message