Mailing-List: contact dev-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of
 prvs=240e050b0=bburruss@expedia.com designates 216.251.112.223 as permitted
 sender)
From: Todd Burruss <bburruss@expedia.com>
To: "dev@cassandra.apache.org" <dev@cassandra.apache.org>
Date: Fri, 23 Sep 2011 15:08:54 -0700
Subject: Re: Assertion
Thread-Topic: Assertion
Thread-Index: Acx6PWJ1F7VFsAbgTLmkQc5h0jOYWw==
Message-ID: <CAA2517B.5208%bburruss@expedia.com>
In-Reply-To: 
 <CALdd-zjWt4jb+X=aPq6kES9a-PdPaDKLbvgRCytrGFL1k_NeEA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
user-agent: Microsoft-MacOutlook/14.12.0.110505
acceptlanguage: en-US
Content-Type: text/plain; charset="iso-8859-2"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

No

On 9/23/11 3:04 PM, "Jonathan Ellis" <jbellis@gmail.com> wrote:

>New errors in the log?
>
>On Fri, Sep 23, 2011 at 4:45 PM, Todd Burruss <bburruss@expedia.com>
>wrote:
>> More information ... My cluster is in the state where I can read, but
>>not
>> write, again.  I used CLI to drop and recreate my keyspace and CFs.  I
>> then started inserting my data.  Before inserting all my test data I
>> starting getting TimedOutException on the client (Hector), then I
>>realized
>> it was in the state where writes are no longer working.  During all my
>> writes I am reading as well.
>>
>> Nodetool reports all nodes are "up", thrift is running, gossip is
>>active,
>> and all are 1.0.0-beta1
>>
>>
>>
>> On 9/23/11 9:40 AM, "Todd Burruss" <bburruss@expedia.com> wrote:
>>
>>>Fyi =A9 I am seeing the exception (at end of message) using 1.0-beta1.
>>>
>>>Notes:
>>>
>>>- I was running 0.8.5 before dropping in 1.0-beta1
>>>- upgraded yaml file to be 1.0
>>>- some CFs were created in 0.8.5 and some in 1.0-beta1
>>>
>>>A couple of observations after seeing this:
>>>
>>>- cannot nicely kill cassandra, must use kill -9
>>>- the CLI can connect and 'get' at ONE or QUORUM, but cannot 'set' at
>>>either CL
>>>
>>>
>>>INFO [HintedHandoff:4] 2011-09-22 22:59:27,626 HintedHandOffManager.java
>>>(line 259) Started hinted handoff for token:
>>>150124573641590498586782915043427152112 with IP: /10.185.35.39
>>>ERROR [HintedHandoff:4] 2011-09-22 22:59:27,648
>>>AbstractCassandraDaemon.java (line 133) Fatal exception in thread
>>>Thread[HintedHandoff:4,5,main]
>>>java.lang.AssertionError
>>>        at
>>>org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpoint(Hint
>>>ed
>>>HandOffManager.java:282)
>>>        at
>>>org.apache.cassandra.db.HintedHandOffManager.access$100(HintedHandOffMan
>>>ag
>>>er.java:81)
>>>        at
>>>org.apache.cassandra.db.HintedHandOffManager$2.runMayThrow(HintedHandOff
>>>Ma
>>>nager.java:333)
>>>        at
>>>org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
>>>        at
>>>java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecuto
>>>r.
>>>java:886)
>>>        at
>>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja
>>>va
>>>:908)
>>>        at java.lang.Thread.run(Thread.java:662)
>>>
>>
>>
>
>
>
>--=20
>Jonathan Ellis
>Project Chair, Apache Cassandra
>co-founder of DataStax, the source for professional Cassandra support
>http://www.datastax.com