cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcus Eriksson (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-10421) Potential issue with LogTransaction as it only checks in a single directory for files
Date Thu, 01 Oct 2015 10:54:27 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939662#comment-14939662
] 

Marcus Eriksson edited comment on CASSANDRA-10421 at 10/1/15 10:54 AM:
-----------------------------------------------------------------------

Actually 6696 was why I stumbled on this, for -two- three reasons:

* I want to model flushing as a single transaction - this means writing files to different
data directories under a single txn. I guess this could be done as multiple transactions though
* Compaction will at times need to write to multiple directories - after say range movements
or disk additions (to rebalance the tokens over the disks again)
* Streaming will have to write one incoming to several directories as the sstables boundaries
will not match on the remote node


was (Author: krummas):
Actually 6696 was why I stumbled on this, for two reasons:

* I want to model flushing as a single transaction - this means writing files to different
data directories under a single txn. I guess this could be done as multiple transactions though
* Compaction will at times need to write to multiple directories - after say range movements
or disk additions (to rebalance the tokens over the disks again)

> Potential issue with LogTransaction as it only checks in a single directory for files
> -------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-10421
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10421
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Marcus Eriksson
>            Assignee: Stefania
>            Priority: Blocker
>             Fix For: 3.0.0 rc2
>
>
> When creating a new LogTransaction we try to create the new logfile in the same directory
as the one we are writing to, but as we use {{[directories.getDirectoryForNewSSTables()|https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/db/lifecycle/LogTransaction.java#L125]}}
this might end up in "any" of the configured data directories. If it does, we will not be
able to clean up leftovers as we check for files in the same directory as the logfile was
created: https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/db/lifecycle/LogRecord.java#L163
> cc [~Stefania]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message