cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Lohfink (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-11483) Enhance sstablemetadata
Date Mon, 04 Apr 2016 04:47:25 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-11483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15223655#comment-15223655
] 

Chris Lohfink commented on CASSANDRA-11483:
-------------------------------------------

While at it, included ansi colors and some extra info
!Screen Shot 2016-04-03 at 11.40.32 PM.png|width=500!

Boring example:
{code}
SSTable: /Users/clohfink/git/sstable-tools/src/test/resources/ma-2-big
Partitions: 1                                                                   
Rows: 1
Tombstones: 0
Cells: 4
Widest Partitions: 
  [frodo] 1
Largest Partitions: 
  [frodo] 104
Partitioner: org.apache.cassandra.dht.Murmur3Partitioner
Bloom Filter FP chance: 0.01
Minimum timestamp: 1455937221199050 (02/19/2016 21:00:21)
Maximum timestamp: 1455937221199050 (02/19/2016 21:00:21)
SSTable min local deletion time: 2147483647 (01/18/2038 21:14:07)
SSTable max local deletion time: 2147483647 (01/18/2038 21:14:07)
Compressor: org.apache.cassandra.io.compress.LZ4Compressor
Compression ratio: -1.0
TTL min: 0 (0 milliseconds)
TTL max: 0 (0 milliseconds)
First token: 6564497868996989420 (frodo)
Last token: 6564497868996989420 (frodo)
minClustringValues: []
maxClustringValues: []
Estimated droppable tombstones: 0.0
SSTable Level: 0
Repaired at: 0 (12/31/1969 18:00:00)
  ReplayPosition(segmentId=1455937219425, position=41561)
totalColumnsSet: 4
totalRows: 1
Estimated tombstone drop times: 
   Drop Time                        | Count  (%)  Histogram 
   2147483647 (01/18/2038 21:14:07) |     4 (100) ██████████████████████████████
   Percentiles
   50th      2395318855 (11/26/2045 08:20:55)
   75th      2395318855 (11/26/2045 08:20:55)
   95th      2395318855 (11/26/2045 08:20:55)
   98th      2395318855 (11/26/2045 08:20:55)
   99th      2395318855 (11/26/2045 08:20:55)
   Min       1996099047 (04/02/2033 18:57:27)
   Max       2395318855 (11/26/2045 08:20:55)
Partition Size: 
   Size (bytes) | Count  (%)  Histogram 
   50 (50 B)    |     1 (100) ██████████████████████████████
   Percentiles
   50th      50 (50 B)
   75th      50 (50 B)
   95th      50 (50 B)
   98th      50 (50 B)
   99th      50 (50 B)
   Min       43 (43 B)
   Max       50 (50 B)
Column Count: 
   Columns | Count  (%)  Histogram 
   4       |     1 (100) ██████████████████████████████
   Percentiles
   50th      4
   75th      4
   95th      4
   98th      4
   99th      4
   Min       4
   Max       4
Estimated cardinality: 1
EncodingStats minTTL: 0 (0 milliseconds)
EncodingStats minLocalDeletionTime: 1442880000 (01/17/1970 10:48:00)
EncodingStats minTimestamp: 1455937221199050 (02/19/2016 21:00:21)
KeyType: org.apache.cassandra.db.marshal.UTF8Type
ClusteringTypes: []
StaticColumns: 
RegularColumns: password:org.apache.cassandra.db.marshal.UTF8Type, gender:org.apache.cassandra.db.marshal.UTF8Type,
state:org.apache.cassandra.db.marshal.UTF8Type, birth_year:org.apache.cassandra.db.marshal.LongType
{code}

Slightly more interesting:
{code}
SSTable: /Users/clohfink/git/sstable-tools/ma-119-big
Partitions: 22515                                                               
Rows: 13579337
Tombstones: 0
Cells: 13579337
Widest Partitions: 
  [12345] 999999
  [99049] 62664
  [99007] 60437
  [99017] 59728
  [99010] 59555
Largest Partitions: 
  [12345] 189888705
  [99049] 2965017
  [99007] 2860391
  [99017] 2826094
  [99010] 2818038
Partitioner: org.apache.cassandra.dht.Murmur3Partitioner
Bloom Filter FP chance: 0.01
Minimum timestamp: 1456554952195298 (02/27/2016 00:35:52)
Maximum timestamp: 1456594562846756 (02/27/2016 11:36:02)
SSTable min local deletion time: 2147483647 (01/18/2038 21:14:07)
SSTable max local deletion time: 2147483647 (01/18/2038 21:14:07)
Compressor: org.apache.cassandra.io.compress.LZ4Compressor
Compression ratio: 0.3068105022732033
TTL min: 0 (0 milliseconds)
TTL max: 0 (0 milliseconds)
First token: 286432166153517 (21139)
Last token: 9223106912315136675 (21299)
minClustringValues: [1]
maxClustringValues: [999999]
Estimated droppable tombstones: 0.0
SSTable Level: 0
Repaired at: 0 (12/31/1969 18:00:00)
  ReplayPosition(segmentId=1456414025108, position=16709244)
totalColumnsSet: 13579337
totalRows: 13579337
Estimated tombstone drop times: 
   Drop Time                        | Count     (%)  Histogram 
   2147483647 (01/18/2038 21:14:07) | 27158674 (100) ██████████████████████████████
   Percentiles
   50th      2395318855 (11/26/2045 08:20:55)
   75th      2395318855 (11/26/2045 08:20:55)
   95th      2395318855 (11/26/2045 08:20:55)
   98th      2395318855 (11/26/2045 08:20:55)
   99th      2395318855 (11/26/2045 08:20:55)
   Min       1996099047 (04/02/2033 18:57:27)
   Max       2395318855 (11/26/2045 08:20:55)
Partition Size: 
   Size (bytes)         | Count  (%)  Histogram 
   258 (258 B)          |     6 (  0) 
   310 (310 B)          |    20 (  0) ▏
   372 (372 B)          |    50 (  0) ▍
   446 (446 B)          |    45 (  0) ▍
   535 (535 B)          |    66 (  0) ▌
   642 (642 B)          |    62 (  0) ▌
   770 (770 B)          |   120 (  0) █
   924 (924 B)          |   116 (  0) ▉
   1109 (1.1 kB)        |   144 (  0) █▏
   1331 (1.3 kB)        |   175 (  0) █▍
   1597 (1.6 kB)        |   210 (  0) █▊
   1916 (1.9 kB)        |   248 (  1) ██
   2299 (2.2 kB)        |   324 (  1) ██▋
   2759 (2.7 kB)        |   356 (  1) ███
   3311 (3.2 kB)        |   460 (  2) ███▉
   3973 (3.9 kB)        |   534 (  2) ████▌
   4768 (4.7 kB)        |   569 (  2) ████▊
   5722 (5.6 kB)        |   667 (  2) █████▋
   6866 (6.7 kB)        |   786 (  3) ██████▋
   8239 (8.0 kB)        |  1002 (  4) ████████▍
   9887 (9.7 kB)        |  1266 (  5) ██████████▋
   11864 (11.6 kB)      |  1446 (  6) ████████████▏
   14237 (13.9 kB)      |  1779 (  7) ███████████████
   17084 (16.7 kB)      |  2081 (  9) █████████████████▌
   20501 (20.0 kB)      |  2598 ( 11) █████████████████████▉
   24601 (24.0 kB)      |  3089 ( 13) ██████████████████████████
   29521 (28.8 kB)      |  3555 ( 15) ██████████████████████████████
   35425 (34.6 kB)      |   681 (  3) █████▋
   42510 (41.5 kB)      |     4 (  0) 
   51012 (49.8 kB)      |     3 (  0) 
   61214 (59.8 kB)      |     1 (  0) 
   73457 (71.7 kB)      |     2 (  0) 
   88148 (86.1 kB)      |     1 (  0) 
   105778 (103.3 kB)    |     3 (  0) 
   126934 (124.0 kB)    |     4 (  0) 
   152321 (148.8 kB)    |     3 (  0) 
   182785 (178.5 kB)    |     2 (  0) 
   219342 (214.2 kB)    |     3 (  0) 
   263210 (257.0 kB)    |     2 (  0) 
   315852 (308.4 kB)    |     3 (  0) 
   454826 (444.2 kB)    |     2 (  0) 
   545791 (533.0 kB)    |     3 (  0) 
   654949 (639.6 kB)    |     4 (  0) 
   785939 (767.5 kB)    |     3 (  0) 
   943127 (921.0 kB)    |     5 (  0) 
   1131752 (1.1 MB)     |     3 (  0) 
   1358102 (1.3 MB)     |     4 (  0) 
   1629722 (1.6 MB)     |     4 (  0) 
   186563160 (177.9 MB) |     1 (  0) 
   Percentiles
   50th      17084 (16.7 kB)
   75th      24601 (24.0 kB)
   95th      29521 (28.8 kB)
   98th      35425 (34.6 kB)
   99th      35425 (34.6 kB)
   Min       216 (216 B)
   Max       186563160 (177.9 MB)
Column Count: 
   Columns | Count  (%)  Histogram 
   10      |    41 (  0) ▎
   12      |    39 (  0) ▎
   14      |    32 (  0) ▎
   17      |    63 (  0) ▌
   20      |    64 (  0) ▌
   24      |   102 (  0) ▉
   29      |   120 (  0) █
   35      |   123 (  0) █
   42      |   165 (  0) █▍
   50      |   189 (  0) █▋
   60      |   220 (  0) █▉
   72      |   313 (  1) ██▋
   86      |   326 (  1) ██▊
   103     |   429 (  1) ███▋
   124     |   493 (  2) ████▎
   149     |   566 (  2) ████▉
   179     |   643 (  2) █████▌
   215     |   765 (  3) ██████▋
   258     |   949 (  4) ████████▏
   310     |  1197 (  5) ██████████▍
   372     |  1382 (  6) ████████████
   446     |  1722 (  7) ██████████████▉
   535     |  1971 (  8) █████████████████
   642     |  2469 ( 10) █████████████████████▍
   770     |  2908 ( 12) █████████████████████████▎
   924     |  3455 ( 15) ██████████████████████████████
   1109    |  1708 (  7) ██████████████▊
   1331    |     1 (  0) 
   1916    |     3 (  0) 
   2299    |     1 (  0) 
   2759    |     2 (  0) 
   3311    |     3 (  0) 
   3973    |     1 (  0) 
   4768    |     1 (  0) 
   5722    |     3 (  0) 
   6866    |     3 (  0) 
   8239    |     3 (  0) 
   9887    |     9 (  0) 
   11864   |     1 (  0) 
   14237   |     1 (  0) 
   17084   |     1 (  0) 
   20501   |     1 (  0) 
   24601   |     3 (  0) 
   29521   |     5 (  0) 
   35425   |     4 (  0) 
   42510   |     3 (  0) 
   51012   |     4 (  0) 
   61214   |     6 (  0) 
   73457   |     1 (  0) 
   1131752 |     1 (  0) 
   Percentiles
   50th      535
   75th      770
   95th      1109
   98th      1109
   99th      1109
   Min       9
   Max       1131752
Estimated cardinality: 22873
EncodingStats minTTL: 0 (0 milliseconds)
EncodingStats minLocalDeletionTime: 1442880000 (01/17/1970 10:48:00)
EncodingStats minTimestamp: 1456554952195298 (02/27/2016 00:35:52)
KeyType: org.apache.cassandra.db.marshal.UTF8Type
ClusteringTypes: [org.apache.cassandra.db.marshal.UTF8Type]
StaticColumns: 
RegularColumns: val:org.apache.cassandra.db.marshal.UTF8Type
{code}

> Enhance sstablemetadata
> -----------------------
>
>                 Key: CASSANDRA-11483
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11483
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Observability
>            Reporter: Chris Lohfink
>            Priority: Minor
>         Attachments: Screen Shot 2016-04-03 at 11.40.32 PM.png
>
>
> sstablemetadata provides quite a bit of useful information but theres a few hiccups I
would like to see addressed:
> * Does not use client mode
> * Units are not provided (or anything for that matter). There is data in micros, millis,
seconds as durations and timestamps from epoch. But there is no way to tell what one is without
a non-trival code dive
> * in general pretty frustrating to parse



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message