hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "terry zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9214) CatalogJanitor delete region info in Meta during Restore snapshot
Date Wed, 14 Aug 2013 10:40:47 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739503#comment-13739503
] 

terry zhang commented on HBASE-9214:
------------------------------------

Below is some log during testing :

1. CatalogJanitor decide to delete region

2013-08-13 16:19:34,268 WARN org.apache.hadoop.hbase.master.CatalogJanitor: Daughter regiondir
does not exist: hdfs://dw77.kgb.sqa.c
m4:9900/hbase-test3-snap/writetest/b95023663816ecf208f7ee3d69d8fb9c
2013-08-13 16:19:34,268 WARN org.apache.hadoop.hbase.master.CatalogJanitor: Daughter regiondir
does not exist: hdfs://dw77.kgb.sqa.c
m4:9900/hbase-test3-snap/writetest/1c47cf89406349c159f36ae2e0c55582
2013-08-13 16:19:34,268 DEBUG org.apache.hadoop.hbase.master.CatalogJanitor: Deleting region
writetest,P7777777777777777777777777777
777777777777777777773,1376370447956.bce523f334ca2c78f2c4ad360dc2a6a4. because daughter splits
no longer hold references

2 . RestoreSnapshotHelper  insert region info to META

2013-08-13 16:19:34,273 DEBUG org.apache.hadoop.hbase.catalog.MetaEditor: Add to META, regions:
[{NAME => 'writetest,HZZZZZZZZZZZZZZ
ZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZX,1376370447956.05a9a252b41e8e41aa3a6a8a797380ab.', STARTKEY
=> 'HZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZ
ZZZZZZZZZZZZZZZZX', ENDKEY => 'LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLI', ENCODED
=> 05a9a252b41e8e41aa3a6a8a797380ab,}, {
NAME => 'writetest,3LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL,1376370447956.5689d3dbc9dc97106c28945ab7bb5104.',
STARTKEY =>
'3LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL', ENDKEY => '77777777777777777777777777777777777777777777777776',
ENCODED => 568
9d3dbc9dc97106c28945ab7bb5104,}, {NAME => 'writetest,77777777777777777777777777777777777777777777777776,1376370447956.5b5a7331c26ead
c41ea2944939fd2cee.', STARTKEY => '77777777777777777777777777777777777777777777777776',
ENDKEY => 'ASSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
SSSSSSSSSSSSSSSSR', ENCODED => 5b5a7331c26eadc41ea2944939fd2cee,}, {NAME => 'writetest,ASSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
SSSSR,1376370447956.60226c1fbedc9d98f1192e37d7d3b6af.', STARTKEY => 'ASSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSR',
ENDKEY =>
'EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEC', ENCODED => 60226c1fbedc9d98f1192e37d7d3b6af,},
{NAME => 'writetest,LLLLLLLLLLL
LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLI,1376370447956.70523ec9e600da52b18caa45cf76cf66.',
STARTKEY => 'LLLLLLLLLLLLLLLLLLLLLLLLLLLLL
LLLLLLLLLLLLLLLLLLLLI', ENDKEY => 'P7777777777777777777777777777777777777777777777773',
ENCODED => 70523ec9e600da52b18caa45cf76cf66,
}, {NAME => 'writetest,SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSO,1376370447956.74f9eef1cbb3e4f6627ee39a0996dec8.',
STARTKEY
 => 'SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSO', ENDKEY => 'WEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE9',
ENCODED =>
 74f9eef1cbb3e4f6627ee39a0996dec8,}, {NAME => 'writetest,WEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE9,1376370447956.82cf586c79
382a89508c3325304904f3.', STARTKEY => 'WEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE9',
ENDKEY => '', ENCODED => 82cf586c79382a8
9508c3325304904f3,}, {NAME => 'writetest,P7777777777777777777777777777777777777777777777773,1
376370447956.bce523f334ca2c78f2c4ad360d
c2a6a4.', STARTKEY => 'P7777777777777777777777777777777777777777777777773', ENDKEY =>
'SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
SSSSO', ENCODED => bce523f334ca2c78f2c4ad360dc2a6a4,}, {NAME => 'writetest,,1376370447944.d3eb975033a94730c88bf6696a413e9e.',
STARTK
EY => '', ENDKEY => '3LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL', ENCODED =>
d3eb975033a94730c88bf6696a413e9e,}, {NAME => 'w
ritetest,EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEC,1376370447956.f03a2b6805852c00e4fe029f3a9e7261.',
STARTKEY => 'EEEEEEEEE
EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEC', ENDKEY => 'HZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZX',
ENCODED => f03a2b6805852
c00e4fe029f3a9e7261,}]

3. region info is delete by CatalogJanitor 

2013-08-13 16:19:34,333 INFO org.apache.hadoop.hbase.catalog.MetaEditor: Deleted region writetest,P777777777777777777777777777777777
7777777777777773,1376370447956.bce523f334ca2c78f2c4ad360dc2a6a4. from META
                
> CatalogJanitor delete region info in Meta during Restore snapshot
> -----------------------------------------------------------------
>
>                 Key: HBASE-9214
>                 URL: https://issues.apache.org/jira/browse/HBASE-9214
>             Project: HBase
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 0.94.10
>            Reporter: terry zhang
>
> Today I meet a issue during restore snapshot. It can be reproduce in step below:
> 1. Table t1 create a Snapshot s1 successfully
> 2. region r1 in t1 split 
> 3. CatalogJanitor Chore begin to work and found daughter  do not have reference , so
r1 can be deleted
> 4. restore snapshot s1 . RestoreSnapshotHelper add region r1 to meta table
> 5.  CatalogJanitor delete r1 region info in meta which RestoreSnapshotHelper just inserted
.
> 6. restore snapshot finished.
> Then we can found there is a hole in t1 after restore snapshot. Data loss.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message