hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4838) Port 2856 (TestAcidGuarantee is failing) to 0.92
Date Fri, 25 Nov 2011 06:42:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13157000#comment-13157000
] 

Lars Hofhansl commented on HBASE-4838:
--------------------------------------

I pinpointed the difference to the compactions of the daughters (again with just 2 keys):

in 0.92 (with this patch) I see this for the 1st daughter region (which is compacted last):

{noformat}
2011-11-24 22:08:51,324 INFO  [RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.HRegion(1012): Starting compaction on testFamily in region testFilterAcrossMutlipleRegions,,1322201330936.0db66f8aabdf138dbbcf6c04f857c284.
2011-11-24 22:08:51,332 INFO  [RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(725): Starting compaction of 1 file(s) in testFamily of testFilterAcrossMutlipleRegions,,1322201330936.0db66f8aabdf138dbbcf6c04f857c284.
into tmpdir=hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/.tmp,
seqid=3, totalSize=662.0
2011-11-24 22:08:51,333 DEBUG [RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(1174): Compacting hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/testFamily/85a0a11b15a248c69e09e44e0e9e052e.4e293f99103a49243c16eb104996554b-hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/4e293f99103a49243c16eb104996554b/testFamily/85a0a11b15a248c69e09e44e0e9e052e-bottom,
keycount=2, bloomtype=NONE, size=662.0
2011-11-24 22:08:51,388 INFO  [RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(1322): Renaming compacted file at hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/.tmp/7e7f4acb121e4696bd3c7d64e26a66b9
to hdfs://localhost:52206/user/lars/testFilterAcrossMutlipleRegions/0db66f8aabdf138dbbcf6c04f857c284/testFamily/7e7f4acb121e4696bd3c7d64e26a66b9
2011-11-24 22:08:51,402 INFO  [RegionServer:2;localhost,42385,1322201325234-smallCompactions-1322201331230]
regionserver.Store(746): Completed major compaction of 1 file(s) in testFamily of testFilterAcrossMutlipleRegions,,1322201330936.0db66f8aabdf138dbbcf6c04f857c284.
into 7e7f4acb121e4696bd3c7d64e26a66b9, size=662.0; total size for store is 662.0
{noformat}

in trunk I see this for the 1st daughter region:

{noformat}
2011-11-24 22:15:18,205 INFO  [RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.HRegion(1097): Starting compaction on testFamily in region testFilterAcrossMutlipleRegions,,1322201717807.2bdeac6934712efdd694ec44ae48d1b2.
2011-11-24 22:15:18,206 INFO  [RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.Store(797): Starting compaction of 1 file(s) in testFamily of testFilterAcrossMutlipleRegions,,1322201717807.2bdeac6934712efdd694ec44ae48d1b2.
into tmpdir=hdfs://localhost:37213/user/lars/testFilterAcrossMutlipleRegions/2bdeac6934712efdd694ec44ae48d1b2/.tmp,
seqid=3, totalSize=718.0
2011-11-24 22:15:18,206 DEBUG [RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.Store(1255): Compacting hdfs://localhost:37213/user/lars/testFilterAcrossMutlipleRegions/2bdeac6934712efdd694ec44ae48d1b2/testFamily/64908313825b4c0599b86c26b33797e3.215be88f57f1ca63b6ead035b39c4d2e-hdfs://localhost:37213/user/lars/testFilterAcrossMutlipleRegions/215be88f57f1ca63b6ead035b39c4d2e/testFamily/64908313825b4c0599b86c26b33797e3-bottom,
keycount=2, bloomtype=NONE, size=718.0
2011-11-24 22:15:18,211 INFO  [RegionServer:0;localhost,46427,1322201712357-smallCompactions-1322201718071]
regionserver.Store(818): Completed major compaction of 1 file(s) in testFamily of testFilterAcrossMutlipleRegions,,1322201717807.2bdeac6934712efdd694ec44ae48d1b2.
into none, size=none; total size for store is 0.0
{noformat}

The keys in both cases are aaa and aab and the split key is aaa, so the 1st region (''-'aaa')
should indeed be empty after compaction. In trunk it is correctly compacted to an empty file.
In 0.92 it somehow wrote out the entire file again (so the keys are found in the store files
for both regions).

                
> Port 2856 (TestAcidGuarantee is failing) to 0.92
> ------------------------------------------------
>
>                 Key: HBASE-4838
>                 URL: https://issues.apache.org/jira/browse/HBASE-4838
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>             Fix For: 0.92.0
>
>         Attachments: 4838-v1.txt
>
>
> Moving back port into a separate issue (as suggested by JonH), because this not trivial.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message