Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8798B10580 for ; Mon, 17 Jun 2013 08:51:35 +0000 (UTC) Received: (qmail 5468 invoked by uid 500); 17 Jun 2013 08:51:33 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 5224 invoked by uid 500); 17 Jun 2013 08:51:32 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 5198 invoked by uid 99); 17 Jun 2013 08:51:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jun 2013 08:51:30 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of samuelsson.joel@gmail.com designates 209.85.217.170 as permitted sender) Received: from [209.85.217.170] (HELO mail-lb0-f170.google.com) (209.85.217.170) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Jun 2013 08:51:23 +0000 Received: by mail-lb0-f170.google.com with SMTP id t13so2290926lbd.15 for ; Mon, 17 Jun 2013 01:51:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=DnesFKG5EzM4M3MBhU1JVROLnPpSdx9Sc4VquK5212A=; b=tcdJtUn4ydwfi41aJ7NhlVx49sYZz5DafrUPJ+ncy9g9jBxlYyQGz8Cb8OPwCmJGaY CZUn5t2+rGlxqFKWexK+Qq/JrbltGY/uK+lo7mLdSpMol4UTmsf9A6uUO5m1u9VKpaJs WRzTwMnJSHIQDQmvqDyCyS14Su4IhQ4Y2nXJR3JHdu5VOmBcUou9V0Z4LlcjrNDdduUe uIsISBVPd4DhahqbkPsLtHgw8kNtasggpn7oc9dr8AisGgIi3aGElvxweGhSmK/5fOC5 tDbGwtwSk/IqJDmA/M9XAaLjVJpjjf+KzDF4TW1y7PWjUd3bFaaTLr4XGfT6XIRak4PK l7zQ== MIME-Version: 1.0 X-Received: by 10.112.164.164 with SMTP id yr4mr5970542lbb.88.1371459062873; Mon, 17 Jun 2013 01:51:02 -0700 (PDT) Received: by 10.114.172.65 with HTTP; Mon, 17 Jun 2013 01:51:02 -0700 (PDT) In-Reply-To: References: <2C85E14562B39345BCCAD90B8E7955C929BE4B@DKEXC002.adform.com> <2C85E14562B39345BCCAD90B8E7955C929C241@DKEXC002.adform.com> <51B237BA.9060809@4friends.od.ua> <6D3C4DCA-8CD6-4D3E-915D-66CFF8323F13@gmail.com> Date: Mon, 17 Jun 2013 10:51:02 +0200 Message-ID: Subject: Re: Reduce Cassandra GC From: Joel Samuelsson To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a1133cb2c44451104df55b2b5 X-Virus-Checked: Checked by ClamAV on apache.org --001a1133cb2c44451104df55b2b5 Content-Type: text/plain; charset=ISO-8859-1 Just got a very long GC again. What am I to look for in the logging I just enabled? 2013/6/17 Joel Samuelsson > > If you are talking about 1.2.x then I also have memory problems on the > idle cluster: java memory constantly slow grows up to limit, then spend > long time for GC. I never seen such behaviour for 1.0.x and 1.1.x, where > on idle cluster java memory stay on the same value. > > No I am running Cassandra 1.1.8. > > > Can you paste you gc config? > > I believe the relevant configs are these: > # GC tuning options > JVM_OPTS="$JVM_OPTS -XX:+UseParNewGC" > JVM_OPTS="$JVM_OPTS -XX:+UseConcMarkSweepGC" > JVM_OPTS="$JVM_OPTS -XX:+CMSParallelRemarkEnabled" > JVM_OPTS="$JVM_OPTS -XX:SurvivorRatio=8" > JVM_OPTS="$JVM_OPTS -XX:MaxTenuringThreshold=1" > JVM_OPTS="$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=75" > JVM_OPTS="$JVM_OPTS -XX:+UseCMSInitiatingOccupancyOnly" > > I haven't changed anything in the environment config up until now. > > > Also can you take a heap dump at 2 diff points so that we can compare > it? > > I can't access the machine at all during the stop-the-world freezes. Was > that what you wanted me to try? > > > Uncomment the followings in "cassandra-env.sh". > Done. Will post results as soon as I get a new stop-the-world gc. > > > If you are unable to find a JIRA, file one > > Unless this turns out to be a problem on my end, I will. > --001a1133cb2c44451104df55b2b5 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Just got a very long GC again. What am I to look for in th= e logging I just enabled?


2013/6/17 Joel Samuelsson <samuelsson.joel@g= mail.com>
> If = you are talking about 1.2.x then I also have memory problems on the idle cl= uster: java memory constantly slow grows up to limit, then spend long time = for GC. I never seen such behaviour for =A01.0.x and 1.1.x, where on idle c= luster java memory stay on the same value.

No I = am running Cassandra 1.1.8.

> Can you paste you gc config?<= /span>

I believe the relevant configs are these:
# GC tuning options
JVM_OPTS=3D"$JVM_OPTS -XX:+UseParNewGC&= quot;=A0
JVM_OPTS=3D"$JVM_OPTS -XX:+Us= eConcMarkSweepGC"=A0
JVM_OPTS=3D"$JVM_OPTS -XX:+CMSParallelRemar= kEnabled"=A0
JVM_OPTS=3D"$JVM_OPT= S -XX:SurvivorRatio=3D8"=A0
JVM_OPTS= =3D"$JVM_OPTS -XX:MaxTenuringThreshold=3D1"
JVM_OPTS=3D"$JVM_OPTS -XX:CMSInitiatingOccu= pancyFraction=3D75"
JVM_OPTS=3D"$= JVM_OPTS -XX:+UseCMSInitiatingOccupancyOnly"

I haven't changed anything in the envi= ronment config up until now.=A0

>=A0Also can you take a hea= p dump at 2 diff points so that we can compare it?

I can't access the machine at all during the stop-the-world freezes= . Was that what you wanted me to try?

&g= t;=A0Uncomment the followings in "cassandra-env.sh".
Done. Will post results as soon as I get = a new stop-the-world gc.

>=A0If you are unable to find a JIRA, file one

Unless this turns out to be a problem on my end, I will.

--001a1133cb2c44451104df55b2b5--