cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-2427) Heuristic or hard cap to prevent fragmented commit logs from bringing down the server
Date Sat, 11 Jun 2011 04:27:59 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13047836#comment-13047836
] 

Hudson commented on CASSANDRA-2427:
-----------------------------------

Integrated in Cassandra #921 (See [https://builds.apache.org/job/Cassandra/921/])
    r/m memtable_flush_after_mins
patch by Patricio Echague; reviewed by jbellis for CASSANDRA-2427

jbellis : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1134504
Files : 
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/CounterSuperColumn.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/KeyCount.java
* /cassandra/trunk/src/java/org/apache/cassandra/db/Table.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/CfDef.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/NotFoundException.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/SliceRange.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/KsDef.java
* /cassandra/trunk/src/java/org/apache/cassandra/db/ColumnFamilyStore.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/CqlResult.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/SlicePredicate.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/ColumnOrSuperColumn.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/AuthenticationRequest.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/AuthenticationException.java
* /cassandra/trunk/src/java/org/apache/cassandra/thrift/ThriftValidation.java
* /cassandra/trunk/src/java/org/apache/cassandra/db/ColumnFamilyStoreMBean.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/ColumnParent.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/SchemaDisagreementException.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/KeyRange.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/SuperColumn.java
* /cassandra/trunk/test/unit/org/apache/cassandra/db/DefsTest.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Column.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/AuthorizationException.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/IndexExpression.java
* /cassandra/trunk/src/java/org/apache/cassandra/cli/CliClient.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Cassandra.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/KeySlice.java
* /cassandra/trunk/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
* /cassandra/trunk/conf/cassandra.yaml
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Deletion.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/IndexClause.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/Mutation.java
* /cassandra/trunk/src/avro/internode.genavro
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/TimedOutException.java
* /cassandra/trunk/src/java/org/apache/cassandra/db/Memtable.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/TokenRange.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/InvalidRequestException.java
* /cassandra/trunk/src/java/org/apache/cassandra/cql/CreateColumnFamilyStatement.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/UnavailableException.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/CounterColumn.java
* /cassandra/trunk/src/resources/org/apache/cassandra/cli/CliHelp.yaml
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/CqlRow.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/ColumnDef.java
* /cassandra/trunk/interface/thrift/gen-java/org/apache/cassandra/thrift/ColumnPath.java
* /cassandra/trunk/src/java/org/apache/cassandra/config/CFMetaData.java


> Heuristic or hard cap to prevent fragmented commit logs from bringing down the server
> -------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-2427
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2427
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: Benjamin Coverston
>            Assignee: Patricio Echague
>              Labels: commitlog, hardening
>             Fix For: 1.0
>
>         Attachments: CASSANDRA-2427-trunk.txt
>
>
> Widely divergent write rates on column families can cause the commit log segments to
fragment. In some cases we have seen the commit log partition overrun.
> One solution here would be to create a heuristic for segment fragmentation to trigger
a flush (commit log segments/memtable) or simply track the free disk space and force a global
flush when the disk gets to 80% capacity.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message