Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 61508E39A for ; Thu, 24 Jan 2013 18:01:50 +0000 (UTC) Received: (qmail 44380 invoked by uid 500); 24 Jan 2013 18:01:45 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 44057 invoked by uid 500); 24 Jan 2013 18:01:45 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 44043 invoked by uid 99); 24 Jan 2013 18:01:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jan 2013 18:01:45 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of wget.null@gmail.com designates 209.85.215.170 as permitted sender) Received: from [209.85.215.170] (HELO mail-ea0-f170.google.com) (209.85.215.170) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jan 2013 18:01:39 +0000 Received: by mail-ea0-f170.google.com with SMTP id a11so4152992eaa.29 for ; Thu, 24 Jan 2013 10:01:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:content-type:mime-version:subject:from:in-reply-to:date :cc:content-transfer-encoding:message-id:references:to:x-mailer; bh=OWuBRUTPbIFa3cxTpN/ecdkvnbUSvQkXYiFpc7f5Kw8=; b=ZQvSFA810w3InUlg20fJVt0XW8wcNIEHwPlsEEb8u35KsQexMVoN/WE6Gl+xVEOuXG L176LNStpsgt4DmvjZ1nTvfBRCqg5e81aQtOMxbzM4D3kXVuKuDIx8xKIbnzY0nLnIuv jGo77roOUJRLvCSXz3loRcVTFGD0Ay0WgEGKizivbvy7AVsOrXDHLMikwMRcUdLWJITn w14gDdIJcrJqK/7StRdgLaxpMNH2/vnxTjF2YC+rBkX2P+M10l1VIhLoybpcgS3UbgGt b7umNyiL2uTZdJfDEBfLZWUWGvI7r0wQ6M+PAc9zc1CnHFMXdVsDZPhicKh/GxKIR/iU /iHg== X-Received: by 10.14.209.131 with SMTP id s3mr8496946eeo.26.1359050478828; Thu, 24 Jan 2013 10:01:18 -0800 (PST) Received: from [192.168.200.51] (HSI-KBW-078-042-203-071.hsi3.kabel-badenwuerttemberg.de. [78.42.203.71]) by mx.google.com with ESMTPS id d3sm36174930eeo.13.2013.01.24.10.01.17 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 24 Jan 2013 10:01:17 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: Support of RHEL version From: Alexander Alten-Lorenz In-Reply-To: Date: Thu, 24 Jan 2013 19:01:16 +0100 Cc: "cdh-user@cloudera.org" Content-Transfer-Encoding: quoted-printable Message-Id: <820BE0DE-159A-4D3F-9B99-D075B9550359@gmail.com> References: To: "user@hadoop.apache.org user@hadoop.apache.org" X-Mailer: Apple Mail (2.1499) X-Virus-Checked: Checked by ClamAV on apache.org Do you mean Transparent Huge Page Defrag = (https://bugzilla.redhat.com/show_bug.cgi?id=3D805593)? Do echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag - Alex On Jan 24, 2013, at 6:46 PM, Dheeren Bebortha = wrote: > I do not think this is a cdh specific issues. If this is a hbase = compaction issue it would be all pervading as long as it si RHEL62 and = above! > Am I reading it right? > -Dheeren >=20 > -----Original Message----- > From: Alexander Alten-Lorenz [mailto:wget.null@gmail.com]=20 > Sent: Thursday, January 24, 2013 9:41 AM > To: cdh-user@cloudera.org > Subject: Re: Support of RHEL version >=20 > Hi, >=20 > Moving the post to cdh-user@cloudera.org > = (https://groups.google.com/a/cloudera.org/forum/?fromgroups=3D#!forum/cdh-= user) > as it is CDH4 you specifically are asking about. BCC'd user@hadoop = lists, lets carry forward the discussion on the CDH lists. My response = below. >=20 > RHEL 5.x and 6.x wil be supported. Means, RHEL 6.3 too. >=20 > Cheers, > Alex >=20 > On Jan 24, 2013, at 6:28 PM, wrote: >=20 >> Hi, >>=20 >> We are working on implementing Cloudera distributed Hadoop (CDH 4.x) = on our environment. Cloudera website talks about supporting RHEL 6.1 = version with challenges/issues with the newer version. It also though = provides a workaround for it. Wanted to hear from the community on the = supported versions of RedHat Linux and any guidance on which version to = choose? >>=20 >> -Nilesh >>=20 >>=20 >> = https://ccp.cloudera.com/display/CDH4DOC/Known+Issues+and+Work+Arounds >> +in+CDH4 >>=20 >>=20 >> Red Hat Linux (RHEL 6.2 and 6.3) >> - Poor performance running Hadoop on RHEL 6.2 or later when=20 >> transparent hugepage compaction is enabled RHEL 6.2 and 6.3 include a = feature called "transparent hugepage compaction" which interacts poorly = with Hadoop workloads. This can cause a serious performance regression = compared to other operating system versions on the same hardware. >> Symptom: top and other system monitoring tools show a large = percentage of the CPU usage classified as "system CPU". If system CPU = usage is 30% or more of the total CPU usage, your system may be = experiencing this issue. >> Bug: https://bugzilla.redhat.com/show_bug.cgi?id=3D805593 >> Severity: Medium (up to 3x performance loss) Anticipated Resolution:=20= >> Currently working with Red Hat to resolve for a future RHEL update >> Workaround: Add the following command to /etc/rc.local to disable = transparent hugepage compaction: >> = ?> ds+in+CDH4> echo never >=20 >> /sys/kernel/mm/redhat_transparent_hugepage/defrag >>=20 >>=20 >=20 > -- > Alexander Alten-Lorenz > http://mapredit.blogspot.com > German Hadoop LinkedIn Group: http://goo.gl/N8pCF >=20 -- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF