Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of goudarzi@gmail.com designates
 209.85.212.44 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <COL121-W113CAE451F6D8094DEECA5FC9C0@phx.gbl>
References: 
 <CAN1VBD-hkfUOg-8ow-65Rg7awhSUGeUadYLaXyOWf8U6w8Tbqg@mail.gmail.com>
	<COL121-W113CAE451F6D8094DEECA5FC9C0@phx.gbl>
Date: Wed, 26 Sep 2012 00:03:34 -0700
Message-ID: 
 <CAN1VBD_qCVxfV7GzKDVKfHO25K9uoUced2mQ_K_BX_a5Zwxd7w@mail.gmail.com>
Subject: Re: 1.1.5 Missing Insert! Strange Problem
From: Arya Goudarzi <goudarzi@gmail.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=bcaec501654dd1e1e004ca956b15

--bcaec501654dd1e1e004ca956b15
Content-Type: text/plain; charset=UTF-8

No. We don't use TTLs.

On Tue, Sep 25, 2012 at 11:47 PM, Roshni Rajagopal <
roshni_rajagopal@hotmail.com> wrote:

>  By any chance is a TTL (time to live ) set on the columns...
>
> ------------------------------
> Date: Tue, 25 Sep 2012 19:56:19 -0700
> Subject: 1.1.5 Missing Insert! Strange Problem
> From: goudarzi@gmail.com
> To: user@cassandra.apache.org
>
>
> Hi All,
>
> I have a 4 node cluster setup in 2 zones with NetworkTopology strategy and
> strategy options for writing a copy to each zone, so the effective load on
> each machine is 50%.
>
> Symptom:
> I have a column family that has gc grace seconds of 10 days (the default).
> On 17th there was an insert done to this column family and from our
> application logs I can see that the client got a successful response back
> with write consistency of ONE. I can verify the existence of the key that
> was inserted in Commitlogs of both replicas however it seams that this
> record was never inserted. I used list to get all the column family rows
> which were about 800ish, and examine them to see if it could possibly be
> deleted by our application. List should have shown them to me since I have
> not gone beyond gc grace seconds if this record was deleted during past
> days. I could not find it.
>
> Things happened:
> During the same time as this insert was happening, I was performing a
> rolling upgrade of Cassandra from 1.1.3 to 1.1.5 by taking one node down at
> a time, performing the package upgrade and restarting the service and going
> to the next node. I could see from system.log that some mutations were
> replayed during those restarts, so I suppose the memtables were not flushed
> before restart.
>
>
> Could this procedure cause the row inser to disappear? How could I
> troubleshoot as I am running out of ideas.
>
> Your help is greatly appreciated.
>
>
> Cheers,
> =Arya
>

--bcaec501654dd1e1e004ca956b15
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

No. We don&#39;t use TTLs.<br><br><div class=3D"gmail_quote">On Tue, Sep 25=
, 2012 at 11:47 PM, Roshni Rajagopal <span dir=3D"ltr">&lt;<a href=3D"mailt=
o:roshni_rajagopal@hotmail.com" target=3D"_blank">roshni_rajagopal@hotmail.=
com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">


<div><div dir=3D"ltr">
By any chance is a TTL (time to live ) set on the columns...<br><br><div><d=
iv></div><hr>Date: Tue, 25 Sep 2012 19:56:19 -0700<br>Subject: 1.1.5 Missin=
g Insert! Strange Problem<br>From: <a href=3D"mailto:goudarzi@gmail.com" ta=
rget=3D"_blank">goudarzi@gmail.com</a><br>
To: <a href=3D"mailto:user@cassandra.apache.org" target=3D"_blank">user@cas=
sandra.apache.org</a><div><div class=3D"h5"><br><br>Hi All,<div><br></div><=
div>I have a 4 node cluster setup in 2 zones with NetworkTopology strategy =
and strategy options for writing a copy to each zone, so the effective load=
 on each machine is 50%.</div>
<div><br></div><div>
Symptom:</div><div>I have a column family that has gc grace seconds of 10 d=
ays (the default). On 17th there was an insert done to this column family a=
nd from our application logs I can see that the client got a successful res=
ponse back with write consistency of ONE. I can verify the existence of the=
 key that was inserted in Commitlogs of both replicas however it seams that=
 this record was never inserted. I used list to get all the column family r=
ows which were about 800ish, and examine them to see if it could possibly b=
e deleted by our application. List should have shown them to me since I hav=
e not gone beyond gc grace seconds if this record was deleted during past d=
ays. I could not find it.=C2=A0</div>

<div><br></div><div>Things happened:</div><div>During the same time as this=
 insert was happening, I was performing a rolling upgrade of Cassandra from=
 1.1.3 to 1.1.5 by taking one node down at a time, performing the package u=
pgrade and restarting the service and going to the next node. I could see f=
rom system.log that some mutations were replayed during those restarts, so =
I suppose the memtables were not flushed before restart.=C2=A0</div>

<div><br></div><div><br></div><div>Could this procedure cause the row inser=
 to disappear? How could I troubleshoot as I am running out of ideas.</div>=
<div><br></div><div>Your help is greatly appreciated.</div><div><br></div>

<div><br></div><div>Cheers,</div><div>=3DArya</div></div></div></div> 		 	 =
  		  </div></div>
</blockquote></div><br>

--bcaec501654dd1e1e004ca956b15--