cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "J.B. Langston (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-8730) Optimize UUIDType comparisons
Date Fri, 06 Feb 2015 20:59:35 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309901#comment-14309901
] 

J.B. Langston edited comment on CASSANDRA-8730 at 2/6/15 8:59 PM:
------------------------------------------------------------------

Looks like a bit of improvement: 12.63MB/sec vs 10.19MB/sec.  Looks like it threw away more
data this time. I guess some tombstones passed gc grace since I last tested. Therefore, I'm
not sure how apples-to-apples the comparison is, so I'm going to try again while setting my
clock back to the date when I ran it before.

Before:

{code}
INFO 15:19:05 Compacted 4 sstables to [./../data/data/ocean/tbl_metric_data_dyn-0f578640a59211e4a5a2ef9f87394ca6/ocean-tbl_metric_data_dyn-ka-144263,].
9,183,829,489 bytes to 9,180,536,394 (~99% of original) in 901,172ms = 9.715395MB/s. 311,495
total partitions merged to 253,490. Partition merge counts were {1:195485, 2:58005, }
{code}

After:

{code}
INFO  20:47:24 Compacted 4 sstables to [./../data/data/ocean/tbl_metric_data_dyn-0f578640a59211e4a5a2ef9f87394ca6/ocean-tbl_metric_data_dyn-ka-144263,].
 8,152,562,772 bytes to 4,659,100,313 (~57% of original) in 615,577ms = 7.218048MB/s.  311,495
total partitions merged to 80,012.  Partition merge counts were {1:195485, 2:58005, }
{code}


was (Author: jblangston@datastax.com):
Looks like a bit of improvement: 12.63MB/sec vs 10.19MB/sec.  Looks like it threw away more
data this time. I guess some tombstones passed gc grace since I last tested. Therefore, I'm
not sure how apples-to-apples the comparison is, so I'm going to try again while setting my
clock back to the date when I ran it before.

Before:

{code}
INFO 15:19:05 Compacted 4 sstables to [./../data/data/ocean/tbl_metric_data_dyn-0f578640a59211e4a5a2ef9f87394ca6/ocean-tbl_metric_data_dyn-ka-144263,].
9,183,829,489 bytes to 9,180,536,394 (~99% of original) in 901,172ms = 9.715395MB/s. 311,495
total partitions merged to 253,490. Partition merge counts were {1:195485, 2:58005, }
{code}

After:

{code}
INFO  20:47:24 Completed flushing /Users/jblangston/repos/cassandra/bin/./../data/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-48-Data.db
(42 bytes) for commitlog position ReplayPosition(segmentId=1423254980101, position=758851)
INFO  20:47:24 Compacted 4 sstables to [./../data/data/ocean/tbl_metric_data_dyn-0f578640a59211e4a5a2ef9f87394ca6/ocean-tbl_metric_data_dyn-ka-144263,].
 8,152,562,772 bytes to 4,659,100,313 (~57% of original) in 615,577ms = 7.218048MB/s.  311,495
total partitions merged to 80,012.  Partition merge counts were {1:195485, 2:58005, }
{code}

> Optimize UUIDType comparisons
> -----------------------------
>
>                 Key: CASSANDRA-8730
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8730
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: J.B. Langston
>            Assignee: Benedict
>             Fix For: 2.1.4
>
>
> Compaction is slow on tables using compound keys containing UUIDs due to being CPU bound
by key comparison.  [~benedict] said he sees some easy optimizations that could be made for
UUID comparison.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message