hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1753) [hbase] Move at end of compaction sometimes fails
Date Wed, 22 Aug 2007 00:12:31 GMT
[hbase] Move at end of compaction sometimes fails
-------------------------------------------------

                 Key: HADOOP-1753
                 URL: https://issues.apache.org/jira/browse/HADOOP-1753
             Project: Hadoop
          Issue Type: Bug
          Components: contrib/hbase
            Reporter: stack
            Assignee: stack


I've seen the following exception a couple of times loading a cluster with data
{code}
2007-08-21 23:52:08,079 INFO org.apache.hadoop.hbase.HRegion: starting compaction on region
hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359
2007-08-21 23:52:08,079 DEBUG org.apache.hadoop.hbase.HStore: started compaction of 3 files
in /bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo
2007-08-21 23:52:13,129 DEBUG org.apache.hadoop.hbase.HStore: moving hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/-1
in /bfd/hadoop-stack-data/tmp/hbase/compaction.tmp to hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/4863512705511503252
in /bfd/hadoop-stack-data/tmp/hbase
2007-08-21 23:52:13,214 ERROR org.apache.hadoop.hbase.HRegionServer: What happens if this
fails? Are we toast?
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File does not exist
        at org.apache.hadoop.dfs.FSDirectory.getFileInfo(FSDirectory.java:747)
        at org.apache.hadoop.dfs.FSNamesystem.getFileInfo(FSNamesystem.java:1253)
        at org.apache.hadoop.dfs.NameNode.getFileInfo(NameNode.java:459)
        at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:566)

        at org.apache.hadoop.ipc.Client.call(Client.java:470)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
        at org.apache.hadoop.dfs.$Proxy0.getFileInfo(Unknown Source)
        at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
        at org.apache.hadoop.dfs.$Proxy0.getFileInfo(Unknown Source)
        at org.apache.hadoop.dfs.DFSClient.getFileInfo(DFSClient.java:431)
        at org.apache.hadoop.dfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:342)
        at org.apache.hadoop.fs.FileSystem.getLength(FileSystem.java:449)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1220)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1215)
        at org.apache.hadoop.io.MapFile$Reader.<init>(MapFile.java:228)
        at org.apache.hadoop.io.MapFile$Reader.<init>(MapFile.java:216)
        at org.apache.hadoop.hbase.HStoreFile$BloomFilterMapFile$Reader.<init>(HStoreFile.java:813)
        at org.apache.hadoop.hbase.HStoreFile.getReader(HStoreFile.java:925)
        at org.apache.hadoop.hbase.HStore.processReadyCompaction(HStore.java:996)
        at org.apache.hadoop.hbase.HStore.compactHelper(HStore.java:658)
        at org.apache.hadoop.hbase.HStore.compactHelper(HStore.java:564)
        at org.apache.hadoop.hbase.HStore.compact(HStore.java:559)
        at org.apache.hadoop.hbase.HRegion.compactStores(HRegion.java:700)
        at org.apache.hadoop.hbase.HRegionServer$SplitOrCompactChecker.run(HRegionServer.java:169)
        at java.lang.Thread.run(Thread.java:619)
{code}
Looking on the filesystem, I see the following for the problematic store:
{code}
/bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/info
 <dir>           2007-08-21 23:52
/bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/info/4863512705511503252
     <r 3>   9       2007-08-21 23:52
/bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/mapfiles
     <dir>           2007-08-21 23:52
/bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/mapfiles/4863512705511503252
 <dir>           2007-08-21 23:52
/bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/mapfiles/4863512705511503252/index
   <r 3>   8340    2007-08-21 23:52
{code}


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message