cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cogumelos Maravilha <cogumelosmaravi...@sapo.pt>
Subject Re: Nodes stopping
Date Thu, 11 May 2017 21:22:39 GMT
Have a look at dmesg. It have already happened to me regarding type i
instances at AWS.


On 11-05-2017 22:17, Daniel Steuernol wrote:
> I had 2 nodes go down today, here is the ERRORs from the system log on
> both nodes
> https://gist.github.com/dlsteuer/28c610bc733a2bff22c8d3953ef8c218
> For some context, I'm trying to get regular repairs going but am
> having issues with it.
>
>
> On May 11 2017, at 2:10 pm, Cogumelos Maravilha
> <cogumelosmaravilha@sapo.pt> wrote:
>
>     Can you grep ERROR system.log
>
>
>     On 11-05-2017 21:52, Daniel Steuernol wrote:
>>     There is nothing in the system log about it being drained or
>>     shutdown, I'm not sure how else it would be pre-empted. No one
>>     else on the team is on the servers and I haven't been shutting
>>     them down. There also is no java memory dump on the server
>>     either. It appears that the process just died.
>>
>>
>>     On May 11 2017, at 1:36 pm, Varun Gupta <varung@uber.com>
>>     <mailto:varung@uber.com> wrote:
>>
>>
>>         What do you mean by "no obvious error in the logs", do you
>>         see node was drained or shutdown. Are you sure, no other
>>         process is calling nodetool drain or shutdown, OR pre-empting
>>         cassandra process?
>>
>>         On Thu, May 11, 2017 at 1:30 PM, Daniel Steuernol
>>         <daniel@sendwithus.com <mailto:daniel@sendwithus.com>> wrote:
>>
>>
>>             I have a 6 node cassandra cluster running, and frequently
>>             a node will go down with no obvious error in the logs.
>>             This is starting to happen quite often, almost daily now.
>>             Any suggestions on how to track down what is causing the
>>             node to stop?
>>             ---------------------------------------------------------------------
>>             To unsubscribe, e-mail:
>>             user-unsubscribe@cassandra.apache.org
>>             <mailto:user-unsubscribe@cassandra.apache.org> For
>>             additional commands, e-mail:
>>             user-help@cassandra.apache.org
>>             <mailto:user-help@cassandra.apache.org> 
>>
>>
>>     ---------------------------------------------------------------------
>>     To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
>>     <mailto:user-unsubscribe@cassandra.apache.org> For additional
>>     commands, e-mail: user-help@cassandra.apache.org
>>     <mailto:user-help@cassandra.apache.org> 
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org For
> additional commands, e-mail: user-help@cassandra.apache.org 


Mime
View raw message