Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
MIME-Version: 1.0
Date: Sat, 13 Feb 2016 01:48:15 -0600
Message-ID: 
 <CAH5CebxYsWoLwt+DL-EB91K1Zs42VV0qA2TQcSqNdorSWVsxTQ@mail.gmail.com>
Subject: Sudden disk usage
From: Branton Davis <branton.davis@spanning.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=001a11440cf8a7c2cc052ba201ad

--001a11440cf8a7c2cc052ba201ad
Content-Type: text/plain; charset=UTF-8

One of our clusters had a strange thing happen tonight.  It's a 3 node
cluster, running 2.1.10.  The primary keyspace has RF 3, vnodes with 256
tokens.

This evening, over the course of about 6 hours, disk usage increased from
around 700GB to around 900GB on only one node.  I was at a loss as to what
was happening and, on a whim, decided to run nodetool cleanup on the
instance.  I had no reason to believe that it was necessary, as no nodes
were added or tokens moved (not intentionally, anyhow).  But it immediately
cleared up that extra space.

I'm pretty lost as to what would have happened here.  Any ideas where to
look?

Thanks!

--001a11440cf8a7c2cc052ba201ad
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">One of our clusters had a strange thing happen tonight.=C2=
=A0 It&#39;s a 3 node cluster, running 2.1.10.=C2=A0 The primary keyspace h=
as RF 3, vnodes with 256 tokens.<div><br></div><div>This evening, over the =
course of about 6 hours, disk usage increased from around 700GB to around 9=
00GB on only one node.=C2=A0 I was at a loss as to what was happening and, =
on a whim, decided to run nodetool cleanup on the instance.=C2=A0 I had no =
reason to believe that it was necessary, as no nodes were added or tokens m=
oved (not intentionally, anyhow).=C2=A0 But it immediately cleared up that =
extra space.</div><div><br></div><div>I&#39;m pretty lost as to what would =
have happened here.=C2=A0 Any ideas where to look?</div><div><br></div><div=
>Thanks!</div><div><div><br></div></div></div>

--001a11440cf8a7c2cc052ba201ad--