incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aaron morton <aa...@thelastpickle.com>
Subject Re: Consistency QUORUM does not work anymore (hector:Could not fullfill request on this host)
Date Tue, 11 Dec 2012 21:45:00 GMT
> Caused by: TimedOutException()
Means the nodes involved in the request did not return to the co ordinator before the rpc_timeout
expired. 

Check the logs on the servers to see if they are overloaded and dropping messages.

Also check that you are not asking for too much data. 

Cheers

-----------------
Aaron Morton
Freelance Cassandra Developer
New Zealand

@aaronmorton
http://www.thelastpickle.com

On 11/12/2012, at 10:13 PM, dong.yajun <dongtalk@gmail.com> wrote:

> hi list, 
> I am using Cassandra with 3 data centers, each DC has more than 10 nodes.
> 
> the schema for a keyspace:
> {DC1:3, DC2:3, DC3:3}
> 
> now, I put some rows using hector with CL Local_Quorum in DC1 ,and then I get a row
with the same CL Local_Quorum in DC1,some exceptions were occured:
> 
> Cassandra with dsc-1.0.5, and Hector with 1.1-2.
> 
> 2012-12-05 21:26:49,667 - WARN [pool-1-thread-3:JCLLoggerAdapter@379] - Could not fullfill
request on this host CassandraClient172.16.74.31:9160-1
> 2012-12-05 21:26:49,668 - WARN [pool-1-thread-3:JCLLoggerAdapter@437] - Exception: 
> me.prettyprint.hector.api.exceptions.HTimedOutException: TimedOutException()
> at me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:35)
> at me.prettyprint.cassandra.service.KeyspaceServiceImpl$3.execute(KeyspaceServiceImpl.java:163)
> at me.prettyprint.cassandra.service.KeyspaceServiceImpl$3.execute(KeyspaceServiceImpl.java:145)
> at me.prettyprint.cassandra.service.Operation.executeAndSetResult(Operation.java:103)
> at me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:258)
> at me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(KeyspaceServiceImpl.java:131)
> at me.prettyprint.cassandra.service.KeyspaceServiceImpl.getRangeSlices(KeyspaceServiceImpl.java:167)
> at me.prettyprint.cassandra.model.thrift.ThriftRangeSlicesQuery$1.doInKeyspace(ThriftRangeSlicesQuery.java:66)
> at me.prettyprint.cassandra.model.thrift.ThriftRangeSlicesQuery$1.doInKeyspace(ThriftRangeSlicesQuery.java:62)
> at me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeasure(KeyspaceOperationCallback.java:20)
> at me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace.java:85)
> at me.prettyprint.cassandra.model.thrift.ThriftRangeSlicesQuery.execute(ThriftRangeSlicesQuery.java:61)
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:176)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> at java.lang.Thread.run(Unknown Source)
> Caused by: TimedOutException()
> at org.apache.cassandra.thrift.Cassandra$get_range_slices_result.read(Cassandra.java:12830)
> at org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassandra.java:762)
> at org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.java:734)
> at me.prettyprint.cassandra.service.KeyspaceServiceImpl$3.execute(KeyspaceServiceImpl.java:151)
> ... 19 more
> 
> any suggestion with this issue? thanks.
> 
> 
> 


Mime
View raw message