cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ben Bromhead <...@instaclustr.com>
Subject Re: Deleted snapshot files filling up /var/lib/cassandra
Date Fri, 20 Mar 2015 16:52:02 GMT
Sorry for the late reply.

To immediately solve the problem you can restart Cassandra and all the open
file descriptors to the deleted snapshots should disappear.

As for why it happened I would first address the disk space issue and see
if the snapshot errors + open file descriptors issue still occurs (I am
unclear as to whether you got the snapshot exception after the disk filled
up or before), if you still have issues with repair not letting go of
snapshotted files even with free disk space I would look to raise a ticket
in Jira.

On 17 March 2015 at 12:46, David Wahler <dwahler@indeed.com> wrote:

> On Mon, Mar 16, 2015 at 6:51 PM, Ben Bromhead <ben@instaclustr.com> wrote:
> > If you are running a sequential repair (or have previously run a
> sequential
> > repair that is still running) Cassandra will still have the file
> descriptors
> > open for files in the snapshot it is using for the repair operation.
>
> Yeah, that aligns with my understanding of how the repair process
> works. But the cluster has no repair sessions active (I think; when I
> run "nodetool tpstats", the AntiEntropyStage and AntiEntropySessions
> values are zero on all nodes) and the space still hasn't been freed.
>



-- 

Ben Bromhead

Instaclustr | www.instaclustr.com | @instaclustr
<http://twitter.com/instaclustr> | (650) 284 9692

Mime
View raw message