cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brandon Williams (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-3115) LongCompactionSpeedTest running longer starting with builds on Aug31
Date Thu, 01 Sep 2011 19:06:12 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095538#comment-13095538
] 

Brandon Williams commented on CASSANDRA-3115:
---------------------------------------------

git bisect blames http://svn.apache.org/viewvc?view=rev&revision=1163205

The only obvious candidate there is the added debug statement, and indeed removing it allows
the test to pass again.  Since the test passes in under 2 minutes but the timeout is 5, this
is likely the per-row BF logging causing it.  Jonathan suggested that we move to the async
appender: http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/AsyncAppender.html

> LongCompactionSpeedTest running longer starting with builds on Aug31
> --------------------------------------------------------------------
>
>                 Key: CASSANDRA-3115
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3115
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.8.5
>         Environment: Cassandra-0.8 branch, nightly builds.
> MacOS and Debian
>            Reporter: Cathy Daw
>            Assignee: Brandon Williams
>            Priority: Minor
>
> The Long tests started consistently timing out as this build of cassandra: [https://jenkins.qa.datastax.com/job/CassandraLong/131/console]
> The regression server shows pretty consistent run times for this test, and then consistent
timeouts from this point forward.
> {code}
>     [junit] Testsuite: org.apache.cassandra.db.compaction.LongCompactionSpeedTest
>     [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 111.379 sec
>     [junit] 
>     [junit] ------------- Standard Output ---------------
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 1637 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: 6144 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 2379 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=500000: 15690 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=500000
colsper=1: 20953 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=1000 colsper=5: 5672 ms
> {code}
> After increasing the timeout, the run time shows are now:
> {code}
>     [junit] Testsuite: org.apache.cassandra.db.compaction.LongCompactionSpeedTest
>     [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 409.486 sec
>     [junit] 
>     [junit] ------------- Standard Output ---------------
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 2465 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: 29407 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 2456 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=500000: 14588 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=500000
colsper=1: 100794 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=1000 colsper=5: 19266 ms
> {code}
> *Single node local run:  Build 1056 / on Aug 30 / Macbook Pro w/ 8 GB ram (all apps shutdown)*
> {panel}
> +Run 1: Fresh install with no log or lib dir+
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 850 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *3004 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 767 ms
>     
> +Run 2: Invoke test without restarting the server+
> 	[junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 826 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *3030 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 776 ms
> +Run 3: Invoke test without restarting the server+
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 830 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *2964 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 635 ms
> +Run 4: Invoke test without restarting the server+
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 931 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *2987 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 910 ms
> {panel}
> *Singled node local run: Build 1062 / on Aug 31 / Macbook pro w/ 8GB ram (all apps shutdown)*
> {panel}
> +Run 1: Fresh restart with no log or lib dir+
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 802 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *17649 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 713 ms
> +Run 2: Invoke test without restarting the server+
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 832 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *16875 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 868 ms
> +Run 3: Invoke test without restarting the server+
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 809 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *16818 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 807 ms
> +Run 4: Invoke test without restarting the server+
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=1
colsper=200000: 834 ms
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=2 rowsper=200000
colsper=1: *16997 ms*
>     [junit] org.apache.cassandra.db.compaction.LongCompactionSpeedTest: sstables=100
rowsper=800 colsper=5: 873 ms
> {panel}
> *Cassandra Build at time of test failure*
> [https://jenkins.qa.datastax.com/job/Cassandra/168/changes]
> {panel}
> Revision: 1163394
> * make Range and Bounds objects client-safe patch by Mck SembWever and jbellis for CASSANDRA-3108
> * Catch invalid key_validation_class before instantiating UpdateColumnFamily patch by
Jonathan Ellis; reviewed by Pavel Yaskevich for CASSANDRA-3102
> * Add validation that Keyspace names are case-insensitively unique patch by Jonathan
Ellis; reviewed by Pavel Yaskevich for CASSANDRA-3066
> * merge from 0.7
> * merge from 0.7
> * merge from 0.7
> * update CHANGES for #3023 and #3044
> Revision 1163394 by jbellis: 
> make Range and Bounds objects client-safe
> patch by Mck SembWever and jbellis for CASSANDRA-3108
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/dht/Range.java
> 	/cassandra/branches/cassandra-0.8/CHANGES.txt
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/dht/Bounds.java
> Revision 1163291 by xedin: 
> Catch invalid key_validation_class before instantiating UpdateColumnFamily
> patch by Jonathan Ellis; reviewed by Pavel Yaskevich for CASSANDRA-3102
> 	/cassandra/branches/cassandra-0.8/CHANGES.txt
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/thrift/ThriftValidation.java
> Revision 1163289 by xedin: 
> Add validation that Keyspace names are case-insensitively unique
> patch by Jonathan Ellis; reviewed by Pavel Yaskevich for CASSANDRA-3066
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/service/ClientState.java
> 	/cassandra/branches/cassandra-0.8/CHANGES.txt
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/thrift/ThriftValidation.java
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/cql/QueryProcessor.java
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/thrift/CassandraServer.java
> Revision 1163281 by jbellis: 
> merge from 0.7
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java
> 	/cassandra/branches/cassandra-0.8/conf/cassandra.yaml
> 	/cassandra/branches/cassandra-0.8/contrib
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/SuperColumn.java
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/NotFoundException.java
> 	/cassandra/branches/cassandra-0.8
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
> Revision 1163268 by jbellis: 
> merge from 0.7
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java
> 	/cassandra/branches/cassandra-0.8/conf/cassandra.yaml
> 	/cassandra/branches/cassandra-0.8/contrib
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/SuperColumn.java
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/NotFoundException.java
> 	/cassandra/branches/cassandra-0.8
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
> Revision 1163235 by jake: 
> merge from 0.7
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java
> 	/cassandra/branches/cassandra-0.8/contrib
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/SuperColumn.java
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/NotFoundException.java
> 	/cassandra/branches/cassandra-0.8
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/service/GCInspector.java
> 	/cassandra/branches/cassandra-0.8/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
> Revision 1163205 by jbellis: 
> update CHANGES for #3023 and #3044
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/utils/BloomFilter.java
> 	/cassandra/branches/cassandra-0.8/CHANGES.txt
> 	/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/utils/BloomCalculations.java
> {panel}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message