hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-7764) [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
Date Fri, 08 Feb 2013 16:35:14 GMT

    [ https://issues.apache.org/jira/browse/HBASE-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13574603#comment-13574603
] 

Jonathan Hsieh commented on HBASE-7764:
---------------------------------------

hm.. also since it was default in 0.94 -- the HBASE-7412 change effectively lowered the region
split max value so it probably made the number of splits go up significantly.
                
> [snapshot 130201 merge] Fix TestSnapshotCloneIndependence failure
> -----------------------------------------------------------------
>
>                 Key: HBASE-7764
>                 URL: https://issues.apache.org/jira/browse/HBASE-7764
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>         Attachments: 7764.txt, 7764-v2.txt, 7764-v3.txt
>
>
> Here is log snippet for TestSnapshotCloneIndependence#testOnlineSnapshotRegionOperationsIndependent
(pay attention to region 1360020297284.2e43e47a882d3cff601eb222cad41f20.):
> {code}
> 2013-02-04 15:24:58,369 INFO  [MASTER_SERVER_OPERATIONS-10.11.2.194,61955,1360020289835-0]
handler.SplitRegionHandler(115): Handled SPLIT event; parent=test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.
daughter a=test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.daughter b=test1360020295791,dgb,1360020297284.b87834cee60702d883aa287df6aaeaef.
> ...
> 2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(78): Starting region operation on test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
> 2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(81): Flush Snapshotting region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
started...
> 2013-02-04 15:25:02,005 DEBUG [member: &apos;10.11.2.194,61958,1360020290064&apos;
subprocedure-pool3-thread-1] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(318):
Completed 2/3 local region snapshots.
> 2013-02-04 15:25:02,005 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2485): Storing region-info for snapshot.
> 2013-02-04 15:25:02,006 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
util.FSUtils(166): Creating file=hdfs://localhost:61942/user/tyu/hbase/.snapshot/.tmp/snapshot_test1360020295791/2e43e47a882d3cff601eb222cad41f20/.tmp/.regioninfo
with permission=rwxrwxrwx
> 2013-02-04 15:25:02,014 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2489): Creating references for hfiles
> 2013-02-04 15:25:02,014 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2502): Adding snapshot references for [hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02]
hfiles
> 2013-02-04 15:25:02,015 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
regionserver.HRegion(2516): Creating reference for file (1/1) : hdfs://localhost:61942/user/tyu/hbase/test1360020295791/2e43e47a882d3cff601eb222cad41f20/fam/946b75e5f0ba445aa1c646b8cbc87e02
> 2013-02-04 15:25:02,017 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(84): ... Flush Snapshotting region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
completed.
> 2013-02-04 15:25:02,017 DEBUG [rs(10.11.2.194,61958,1360020290064)-snapshot-pool5-thread-1]
snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(86): Closing region operation on test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
> ...
> 2013-02-04 15:25:03,836 INFO  [PRI IPC Server handler 7 on 61958] regionserver.HRegionServer(3600):
Splitting test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
> 2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958] regionserver.HStore(1686):
cannot split because midkey is the same as first or last row
> 2013-02-04 15:25:03,836 DEBUG [PRI IPC Server handler 7 on 61958] regionserver.CompactSplitThread(172):
Region test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20. not splittable because
midkey=null
> 2013-02-04 15:25:03,837 DEBUG [main] catalog.CatalogTracker(231): Stopping catalog tracker
org.apache.hadoop.hbase.catalog.CatalogTracker@5c602d9d
> 2013-02-04 15:25:03,838 INFO  [main] client.TestSnapshotCloneIndependence(307): split
requested for test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
> 2013-02-04 15:25:03,892 DEBUG [main] client.MetaScanner(199): Scanning .META. starting
at row=test1360020295791,,00000000000000 for max=2147483647 rows using hconnection 0x53d9f80
> 2013-02-04 15:25:03,895 DEBUG [main] client.MetaScanner(252): Current INFO from scan
results = {NAME =&gt; &apos;test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.&apos;,
STARTKEY =&gt; &apos;&apos;, ENDKEY =&gt; &apos;&apos;, ENCODED =&gt;
794d37c0445b61619b5056623228827d, OFFLINE =&gt; true, SPLIT =&gt; true,}
> 2013-02-04 15:25:03,896 DEBUG [main] client.MetaScanner(252): Current INFO from scan
results = {NAME =&gt; &apos;test1360020295791,,1360020295793.794d37c0445b61619b5056623228827d.&apos;,
STARTKEY =&gt; &apos;&apos;, ENDKEY =&gt; &apos;&apos;, ENCODED =&gt;
794d37c0445b61619b5056623228827d, OFFLINE =&gt; true, SPLIT =&gt; true,}
> 2013-02-04 15:25:03,896 DEBUG [main] client.MetaScanner$BlockingMetaScannerVisitor(441):
blocking until region is in META: test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.
> 2013-02-04 15:25:03,897 DEBUG [main] client.MetaScanner(252): Current INFO from scan
results = {NAME =&gt; &apos;test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.&apos;,
STARTKEY =&gt; &apos;&apos;, ENDKEY =&gt; &apos;dgb&apos;, ENCODED
=&gt; 2e43e47a882d3cff601eb222cad41f20,}
> 2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan
results = {NAME =&gt; &apos;test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.&apos;,
STARTKEY =&gt; &apos;&apos;, ENDKEY =&gt; &apos;dgb&apos;, ENCODED
=&gt; 2e43e47a882d3cff601eb222cad41f20,}
> 2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan
results = {NAME =&gt; &apos;test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.&apos;,
STARTKEY =&gt; &apos;&apos;, ENDKEY =&gt; &apos;dgb&apos;, ENCODED
=&gt; 2e43e47a882d3cff601eb222cad41f20,}
> 2013-02-04 15:25:03,898 DEBUG [main] client.MetaScanner(252): Current INFO from scan
results = {NAME =&gt; &apos;test1360020295791,,1360020297284.2e43e47a882d3cff601eb222cad41f20.&apos;,
STARTKEY =&gt; &apos;&apos;, ENDKEY =&gt; &apos;dgb&apos;, ENCODED
=&gt; 2e43e47a882d3cff601eb222cad41f20,}
> {code}
> In the code we choose the first region from the original table to split which happens
to be not splittable.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message