Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 27E2B6FCD for ; Thu, 26 May 2011 17:31:29 +0000 (UTC) Received: (qmail 62037 invoked by uid 500); 26 May 2011 17:31:27 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 62002 invoked by uid 500); 26 May 2011 17:31:27 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 61994 invoked by uid 99); 26 May 2011 17:31:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 May 2011 17:31:27 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates 209.85.216.41 as permitted sender) Received: from [209.85.216.41] (HELO mail-qw0-f41.google.com) (209.85.216.41) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 May 2011 17:31:20 +0000 Received: by qwa26 with SMTP id 26so699496qwa.14 for ; Thu, 26 May 2011 10:30:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; bh=xX4BNQD97xFFWPId5vj+s4OSNni7Q0KC5UWVX0WBYeU=; b=A2kDqPyU0ZHZhl3/g3p6FWQGUojwl8OlPGJP5VqeX+6BBK8XtHC61SzycdNaH7o9R5 qfUMST9vCqJjruXcC4R3v25Pdk505JbjR/6hu8X25Grv1bjczJ2tofvvqf4cInNXFJvi wu2A5r1/YGupqBy8jeSY3d+eFs+iCk9t6x16A= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; b=dd7liZ9uRfF/rBmQbovYZt5alUrIoVdTKIUkyTNSURR1Qt9lKwtmB6c5zWg3h5n/KH QkXaHRE6qKYBa3lxAyEyWIJ0GWDcjNLJW3hnCL9sBvfPUBT/t1UEvN7PqMMdPITRVLx9 nJqw4JR+QSOFmGSf+3xwR/vHi7y3JqK2C8g+4= MIME-Version: 1.0 Received: by 10.224.182.193 with SMTP id cd1mr904219qab.36.1306431059262; Thu, 26 May 2011 10:30:59 -0700 (PDT) Sender: saint.ack@gmail.com Received: by 10.224.19.208 with HTTP; Thu, 26 May 2011 10:30:59 -0700 (PDT) In-Reply-To: References: Date: Thu, 26 May 2011 10:30:59 -0700 X-Google-Sender-Auth: 1JBXl9tDg9zsBrNy_jZQQTDPpKg Message-ID: Subject: Re: mslab enabled jvm crash From: Stack To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org On Thu, May 26, 2011 at 9:00 AM, Wayne wrote: > Looking more closely I can see that we are still > getting Concurrent Mode Failures on some of the nodes but they are only > lasting for 10s so the nodes don't go away. Is this considered "normal"? > With CMSInitiatingOccupancyFraction=65 I would suspect this is not normal?? > What configs. are you running with now? It looks like you either left parnew as unbounded or else you set it to 256M max? So you did not change the parnew size? Did you up your heap size? I see you are getting 'promotion failed'/'concurrent mode failure'. How long has it been running now? St.Ack