hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kannan Muthukkaruppan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5907) enhance HLog pretty printer to print additional useful stats
Date Wed, 02 May 2012 17:30:50 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13266739#comment-13266739
] 

Kannan Muthukkaruppan commented on HBASE-5907:
----------------------------------------------

Sample run:

{code}
% bin/hbase org.apache.hadoop.hbase.regionserver.wal.HLog --dump <PathToHLog>  --analyze

=== SUMMARY ===
Number of txns: 49398
Number of KVs: 943861
Total Size of KVs: 244004297
Avg number of KVs/txn: 19
Avg size of txn: 4939
Avg size of KV: 258
Avg CFs written to per txn: 5
Txns/sec: 380
 KVs/sec: 7279
======= CF Level Stats ======
    # of KVs|CF Name
      372739 test_table:cf1
      257880 test_table:cf3
       82845 test_table:cf2
       72649 test_table:cf7
       38224 test_table:cf4
       36213 test_table:cf6
       29446 test_table:cf10
       26787 test_table:cf5
       26787 test_table:cf9
         288 test_table:cf8
           3 test_table:METAFAMILY
=====
Total KVSize|CF Name
    56814996 test_table:cf3
    51452389 test_table:cf6
    42377022 test_table:cf1
    39258289 test_table:cf4
    31404256 test_table:cf2
     9814939 test_table:cf7
     4727038 test_table:cf9
     4708267 test_table:cf10
     3412347 test_table:cf5
       34592 test_table:cf8
         162 test_table:METAFAMILY
=====
 == TxnCount|Put/Delete's CF Signature ==
       26602 test_table:[cf1, cf2, cf3, cf4, cf5, cf6, cf7, cf9, cf10]
       12247 test_table:[cf3]
        9311 test_table:[cf3, cf4, cf6]
         937 test_table:[cf3, cf4]
         176 test_table:[cf1, cf2, cf3, cf4, cf5, cf6, cf7, cf8, cf9, cf10]
         110 test_table:[cf2, cf3, cf4, cf6, cf7, cf8, cf10]
           9 test_table:[cf2, cf3, cf4, cf5, cf6, cf9, cf10]
           3 test_table:[METAFAMILY]
           2 test_table:[cf3, cf4, cf6, cf7]
           1 test_table:[cf3, cf8]
===========================
{code}
                
> enhance HLog pretty printer to print additional useful stats
> ------------------------------------------------------------
>
>                 Key: HBASE-5907
>                 URL: https://issues.apache.org/jira/browse/HBASE-5907
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Kannan Muthukkaruppan
>            Priority: Minor
>         Attachments: D2979.1.patch, D2979.2.patch
>
>
> It would be useful for analysis purposes to enhance the HLog pretty printer to optionally
print a bunch of additional stats such as:
> 1) # of txns
> 2) # of KVs updated
> 3) avg size of txns
> 4) avg size of KVs
> 5) avg # of KVs written per txn
> 5) unique CF signatures involved in put/delete operatons; and breakdown of some of the
above metrics by these signatures, etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message