Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E23B9DD7A for ; Sun, 1 Jul 2012 08:49:37 +0000 (UTC) Received: (qmail 87341 invoked by uid 500); 1 Jul 2012 08:49:35 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 87302 invoked by uid 500); 1 Jul 2012 08:49:34 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 87288 invoked by uid 99); 1 Jul 2012 08:49:34 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 01 Jul 2012 08:49:34 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=FSL_RCVD_USER,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of hontvari@flyordie.com designates 95.211.130.66 as permitted sender) Received: from [95.211.130.66] (HELO mail.flyordie.com) (95.211.130.66) by apache.org (qpsmtpd/0.29) with SMTP; Sun, 01 Jul 2012 08:49:24 +0000 Received: from [192.168.0.5] (87-97-119-114.pool.invitel.hu [87.97.119.114]) by mail.flyordie.com with SMTP (Mireka 3.2beta2) for user@cassandra.apache.org; Sun, 01 Jul 2012 10:49:04 +0200 (CEST) Message-ID: <4FF00EFF.4000703@flyordie.com> Date: Sun, 01 Jul 2012 10:49:03 +0200 From: =?ISO-8859-1?Q?Hontv=E1ri_J=F3zsef_Levente?= User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:13.0) Gecko/20120614 Thunderbird/13.0.1 MIME-Version: 1.0 To: user@cassandra.apache.org Subject: Re: High CPU usage as of 8pm eastern time References: <2AF22870-3959-47DF-83C9-AADC37610800@bloomdigital.com> In-Reply-To: <2AF22870-3959-47DF-83C9-AADC37610800@bloomdigital.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Thank you for the mail. Same here, but I restarted the affected server before I noticed your mail. It affected both OpenJDK Java 6 (packaged with Ubuntu 10.04) and Oracle Java 7 processes. Ubuntu 32 bit servers had no issues, only a 64 bit machine. Likely it is related to the leap second introduced today. On 2012.07.01. 5:11, Mina Naguib wrote: > Hi folks > > Our cassandra (and other java-based apps) started experiencing extremely high CPU usage as of 8pm eastern time (midnight UTC). > > The issue appears to be related to specific versions of java + linux + ntpd > > There are many solutions floating around on IRC, twitter, stackexchange, LKML. > > The simplest one that worked for us is simply to run this command on each affected machine: > > date; date `date +"%m%d%H%M%C%y.%S"`; date; > > CPU drop was instantaneous - there was no need to restart the server, ntpd, or any of the affected JVMs. > > > >