incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dane Miller <d...@optimalsocial.com>
Subject Re: unexplained hinted handoff
Date Fri, 12 Apr 2013 20:23:11 GMT
On Fri, Apr 12, 2013 at 1:12 PM, Dane Miller <dane@optimalsocial.com> wrote:
> I'm seeing hinted handoff kick in on all our nodes during periods of
> high activity, but all the nodes seem to be up (according to the logs
> and nodetool status).  The pattern in the logs is something like this:
>
> 18:10:45 194 READ messages dropped in last 5000ms
> 18:11:10 Started hinted handoff for host:
> 7668c813-41a9-4d42-b362-5420528fefa0 with IP: /10....
> 18:11:11 Finished hinted handoff of 13 rows to endpoint /10....
>
> This happens on all the nodes every 10 min, and with a different
> endpoint each time.  tpstats shows thousands of dropped reads, but no
> other types of messages are dropped.
>
> Do slow reads trigger hint storage?  If hints are being stored,
> doesn't that imply DOWN nodes, and why don't I see that in the logs?

Sorry, meant to add: Cassandra 1.2.3, Ubuntu 12.04 x64

Mime
View raw message