cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Ellis <jbel...@gmail.com>
Subject Re: Cassandra restart
Date Wed, 14 Oct 2009 13:28:54 GMT
Why is it timing out?

2009/10/14 Teodor Sigaev <teodor@sigaev.ru>:
> I have 12-nodes cassandra's cluster, after restart (really, upgrade from
> 0.4.0 to 0.4.1) of one node it writes in log a lot of messages like:
> ERROR [pool-1-thread-46] 2009-10-14 17:06:40,804 Cassandra.java (line 679)
> Internal error processing get_slice
> java.lang.RuntimeException: error reading key 00000000000028344851
>        at
> org.apache.cassandra.service.StorageProxy.weakReadRemote(StorageProxy.java:265)
>        at
> org.apache.cassandra.service.StorageProxy.readProtocol(StorageProxy.java:312)
>        at
> org.apache.cassandra.service.CassandraServer.readColumnFamily(CassandraServer.java:100)
>        at
> org.apache.cassandra.service.CassandraServer.getSlice(CassandraServer.java:182)
>        at
> org.apache.cassandra.service.CassandraServer.multigetSliceInternal(CassandraServer.java:251)
>        at
> org.apache.cassandra.service.CassandraServer.get_slice(CassandraServer.java:220)
>        at
> org.apache.cassandra.service.Cassandra$Processor$get_slice.process(Cassandra.java:671)
>        at
> org.apache.cassandra.service.Cassandra$Processor.process(Cassandra.java:627)
>        at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:253)
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> Caused by: java.util.concurrent.TimeoutException: Operation timed out.
>        at org.apache.cassandra.net.AsyncResult.get(AsyncResult.java:97)
>        at
> org.apache.cassandra.service.StorageProxy.weakReadRemote(StorageProxy.java:261)
>        ... 11 more
>
>
> Read from that key from another nodes is ok, but reading from restarted
> timeouted with that message.
>
> Is some rules/recommendation to restart node?
>
>
>
> --
> Teodor Sigaev                                   E-mail: teodor@sigaev.ru
>                                                   WWW: http://www.sigaev.ru/
>

Mime
View raw message