Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of mightye@gmail.com designates
 209.85.215.43 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <2F77FA13-FE1C-4989-9719-7B6A2C7A5B50@grapheffect.com>
References: <2F77FA13-FE1C-4989-9719-7B6A2C7A5B50@grapheffect.com>
From: Eric Stevens <mightye@gmail.com>
Date: Wed, 3 Jul 2013 07:56:26 -0400
Message-ID: 
 <CAORswtxDoPyF1Xv0jr5vaptNgXKNtrpyR45TrbvMsUuhfdaCtA@mail.gmail.com>
Subject: Re: columns disappearing intermittently
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=001a11c22578ee754304e09a27f8

--001a11c22578ee754304e09a27f8
Content-Type: text/plain; charset=UTF-8

I wonder if one particular node is having trouble; when you notice the
missing column, what happens if you execute the read manually from cqlsh or
cassandra-cli independently directly on each node?


On Wed, Jul 3, 2013 at 2:00 AM, Blake Eggleston <blake@grapheffect.com>wrote:

> Hi All,
>
> We're having a problem with our cassandra cluster and are at a loss as to
> the cause.
>
> We have what appear to be columns that disappear for a little while, then
> reappear. The rest of the row is returned normally during this time. This
> is, of course, very disturbing, and is wreaking havoc with our application.
>
> A bit more info about what's happening:
>
> We are repeatedly executing the same query against our cluster. Every so
> often, one of the columns will disappear from the row and will remain gone
> for some time. Then after continually executing the same query, the column
> will come back. The queries are being executed against a 3 node cluster,
> with a replication factor of 3, and all reads and writes are done with a
> quorum consistency level.
>
> We upgraded from cassandra 1.1.12 to 1.2.6 last week, but only started
> seeing issues this morning.
>
> Has anyone had a problem like this before, or have any idea what might be
> causing it?

--001a11c22578ee754304e09a27f8
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I wonder if one particular node is having trouble; when yo=
u notice the missing column, what happens if you execute the read manually =
from cqlsh or cassandra-cli independently directly on each node? =C2=A0</di=
v><div class=3D"gmail_extra">

<br><br><div class=3D"gmail_quote">On Wed, Jul 3, 2013 at 2:00 AM, Blake Eg=
gleston <span dir=3D"ltr">&lt;<a href=3D"mailto:blake@grapheffect.com" targ=
et=3D"_blank">blake@grapheffect.com</a>&gt;</span> wrote:<br><blockquote cl=
ass=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;p=
adding-left:1ex">

Hi All,<br>
<br>
We&#39;re having a problem with our cassandra cluster and are at a loss as =
to the cause.<br>
<br>
We have what appear to be columns that disappear for a little while, then r=
eappear. The rest of the row is returned normally during this time. This is=
, of course, very disturbing, and is wreaking havoc with our application.<b=
r>


<br>
A bit more info about what&#39;s happening:<br>
<br>
We are repeatedly executing the same query against our cluster. Every so of=
ten, one of the columns will disappear from the row and will remain gone fo=
r some time. Then after continually executing the same query, the column wi=
ll come back. The queries are being executed against a 3 node cluster, with=
 a replication factor of 3, and all reads and writes are done with a quorum=
 consistency level.<br>


<br>
We upgraded from cassandra 1.1.12 to 1.2.6 last week, but only started seei=
ng issues this morning.<br>
<br>
Has anyone had a problem like this before, or have any idea what might be c=
ausing it?</blockquote></div><br></div>

--001a11c22578ee754304e09a27f8--