cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cameron Hatfield (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-8028) Unable to compute when histogram overflowed
Date Thu, 16 Oct 2014 22:42:34 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174385#comment-14174385
] 

Cameron Hatfield commented on CASSANDRA-8028:
---------------------------------------------

Looks like this doesn't fully resolve the issue. According to running sstablemetadata on a
2.1.0 sstable file, as well as MetadataCollector.java: https://github.com/apache/cassandra/blob/8d8fed52242c34b477d0384ba1d1ce3978efbbe8/src/java/org/apache/cassandra/io/sstable/metadata/MetadataCollector.java#L59

the sstable metadata persisted for these histograms are actually stored with a larger number
of buckets then 90. The issue seems to be both the nodetool, https://github.com/apache/cassandra/blob/810c2d5fe64333c0bcfe0b2ed3ea2c8f6aaf89b7/src/java/org/apache/cassandra/tools/NodeTool.java#L892,
as well as ColumnFamilyMetrics https://github.com/apache/cassandra/blob/ed1f39480606c95ff6595aad0aad9c1af7460f74/src/java/org/apache/cassandra/metrics/ColumnFamilyMetrics.java#L220
have a hardcoded value of 90. If that was raised, then we would be able to display the non-overflowed
histograms stored in the metadata.

Example output from sstablemetadata (notice that number of rows is 115 and 150, not 90 and
90) :
[cameron@cass-db01 <removed>]$ sstablemetadata <removed>-<removed>-ka-33-Data.db
SSTable: ./<removed>-<removed>-ka-33
Partitioner: org.apache.cassandra.dht.Murmur3Partitioner
Bloom Filter FP chance: 0.010000
Minimum timestamp: 1413408134518716
Maximum timestamp: 1413410874004562
SSTable max local deletion time: 2147483647
Compression ratio: 0.2157516194949938
Estimated droppable tombstones: 0.026257982293749805
SSTable Level: 0
Repaired at: 0
ReplayPosition(segmentId=1413409259260, position=15051162)
Estimated tombstone drop times:%n
1413408139:      1647
1413408151:      2451
1413408165:      3151
1413408180:      3400
1413408199:      3027
1413408214:      2769
1413408228:      2064
1413408244:      1779
1413408261:      3817
1413408280:      7265
1413408302:      1911
1413408319:      1512
1413408337:      1582
1413408354:      1712
1413408375:      1577
1413408393:      2507
1413408411:      1410
1413408431:       761
1413408447:       507
1413408466:      2593
1413408483:      3840
1413408503:      1557
1413408523:       819
1413409632:       742
1413409646:       641
1413409662:       473
1413409684:       704
1413409700:       762
1413409716:       601
1413409728:       125
1413409744:      1190
1413409763:      1181
1413409783:      1768
1413409800:      1730
1413409820:      1326
1413409837:      1273
1413409856:      1299
1413409871:      2663
1413409887:      2197
1413409901:      1776
1413409917:       871
1413409934:      1449
1413409952:      1700
1413409969:      1301
1413409984:      2100
1413410002:      2103
1413410021:      1208
1413410039:       923
1413410052:      1425
1413410068:      1796
1413410081:      2263
1413410095:      2664
1413410110:      3019
1413410128:      2823
1413410146:      3801
1413410160:      3864
1413410175:      3252
1413410188:      8337
1413410204:      9375
1413410219:      6125
1413410235:      7954
1413410254:     11019
1413410271:     12703
1413410287:     12274
1413410303:     12199
1413410317:     10751
1413410330:     11369
1413410343:     10552
1413410355:      8157
1413410369:      8776
1413410384:      7504
1413410400:      7312
1413410418:      7472
1413410434:      7032
1413410448:      6338
1413410465:      5335
1413410484:      6427
1413410504:      7897
1413410523:      8515
1413410539:      4886
1413410557:      4847
1413410576:      4987
1413410591:      7630
1413410611:      8553
1413410628:     12157
1413410645:     12740
1413410663:     13756
1413410679:     19249
1413410695:     19374
1413410713:     15390
1413410732:     13493
1413410746:     13793
1413410760:     16937
1413410775:     19841
1413410791:     16595
1413410808:     19050
1413410823:     18450
1413410840:     22497
1413410861:     34027
1413410872:        16
Count               Row Size        Cell Count
1                          0                 0
2                          0                 0
3                          0                 0
4                          0                16
5                          0                 0
6                          0                 0
7                          0                 0
8                          0                35
10                         0                 0
12                         0                17
14                         0                 0
17                         0                29
20                         0                14
24                         0                21
29                         0                12
35                         0                13
42                         0                40
50                         0                19
60                         0                30
72                         0                32
86                         0                39
103                        0                32
124                        0                53
149                        0                40
179                        0                55
215                        0                62
258                        0                71
310                        0               107
372                        0               148
446                        5               185
535                        4               211
642                        2               182
770                        0               130
924                       12               180
1109                       4               201
1331                      14               172
1597                       9               201
1916                      15               182
2299                      30               204
2759                      12               197
3311                      14               315
3973                      20               203
4768                      24               122
5722                      13               155
6866                      18               197
8239                      23               115
9887                      30               133
11864                     22               102
14237                     40                59
17084                     39                62
20501                     51                78
24601                     32                49
29521                     55                46
35425                     67                58
42510                     87                27
51012                    166                26
61214                    140                11
73457                    127                 9
88148                    124                 0
105778                   125                 0
126934                   173                 0
152321                   225                 0
182785                   174                 0
219342                   200                 0
263210                   215                 0
315852                   216                 0
379022                   204                 0
454826                   206                 0
545791                   181                 0
654949                   187                 0
785939                   230                 0
943127                   184                 0
1131752                  122                 0
1358102                  103                 0
1629722                  135                 0
1955666                   53                 0
2346799                   83                 0
2816159                   45                 0
3379391                   67                 0
4055269                   56                 0
4866323                   60                 0
5839588                   67                 0
7007506                   36                 0
8409007                   60                 0
10090808                  38                 0
12108970                  28                 0
14530764                  14                 0
17436917                   7                 0
20924300                   4                 0
25109160                   0                 0
30130992                   0                 0
36157190                   0                 0
43388628                   0                 0
52066354                   0                 0
62479625                   0                 0
74975550                   0                 0
89970660                   0                 0
107964792                  0                 0
129557750                  0                 0
155469300                  0                 0
186563160                  0                 0
223875792                  0                 0
268650950                  0                 0
322381140                  0                 0
386857368                  0                 0
464228842                  0                 0
557074610                  0                 0
668489532                  0                 0
802187438                  0                 0
962624926                  0                 0
1155149911                 0                 0
1386179893                 0                 0
1663415872                 0                 0
1996099046                 0                 0
2395318855                 0                 0
2874382626                 0
3449259151                 0
4139110981                 0
4966933177                 0
5960319812                 0
7152383774                 0
8582860529                 0
10299432635                 0
12359319162                 0
14831182994                 0
17797419593                 0
21356903512                 0
25628284214                 0
30753941057                 0
36904729268                 0
44285675122                 0
53142810146                 0
63771372175                 0
76525646610                 0
91830775932                 0
110196931118                 0
132236317342                 0
158683580810                 0
190420296972                 0
228504356366                 0
274205227639                 0
329046273167                 0
394855527800                 0
473826633360                 0
568591960032                 0
682310352038                 0
818772422446                 0
982526906935                 0
1179032288322                 0
1414838745986                 0
Ancestors: [237, 222, 227, 201, 243, 174]
Estimated cardinality: 4696

> Unable to compute when histogram overflowed
> -------------------------------------------
>
>                 Key: CASSANDRA-8028
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8028
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tools
>         Environment: Linux
>            Reporter: Gianluca Borello
>            Assignee: Carl Yeksigian
>             Fix For: 2.1.2
>
>         Attachments: 8028-2.1.txt
>
>
> It seems like with 2.1.0 histograms can't be computed most of the times:
> $ nodetool cfhistograms draios top_files_by_agent1
> nodetool: Unable to compute when histogram overflowed
> See 'nodetool help' or 'nodetool help <command>'.
> I can probably find a way to attach a .cql script to reproduce it, but I suspect it must
be obvious to replicate it as it happens on more than 50% of my column families.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message