Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 38F7B18AB5 for ; Sat, 19 Sep 2015 12:51:10 +0000 (UTC) Received: (qmail 39913 invoked by uid 500); 19 Sep 2015 12:51:04 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 39676 invoked by uid 500); 19 Sep 2015 12:51:04 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 39647 invoked by uid 99); 19 Sep 2015 12:51:04 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 19 Sep 2015 12:51:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 91A61C098E for ; Sat, 19 Sep 2015 12:51:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.88 X-Spam-Level: ** X-Spam-Status: No, score=2.88 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id rth8XswGeeLO for ; Sat, 19 Sep 2015 12:50:58 +0000 (UTC) Received: from mail-oi0-f53.google.com (mail-oi0-f53.google.com [209.85.218.53]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 70CC142B0A for ; Sat, 19 Sep 2015 12:50:58 +0000 (UTC) Received: by oixx17 with SMTP id x17so39263806oix.0 for ; Sat, 19 Sep 2015 05:50:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=UtuX1w3rS/HkSbFhwPkzqJTTotHFrlp8O1t+2R621cE=; b=YDmUgAIKbAFeyTac1nJ/RzlP3rvFXbYAdHNP4FfQzzNU1yC4NIyvsMhVQK0eBdCdQv R4TrD1ZQPrLsEU2WZqnnZEGzVaWfIVMilJnFVlvv3IC13Q1u2jfAAhqgxPsbhcdwf/Zp m9aUFvlN9RjFHkwRMCga87Lv8fYpPEiZ1+269xmocNFkNie9tpsV9wVz2bERriQLdhkE SpbGumOLPVFjChYsiziGSJea4EZHt8r6CODYariqTvC2jX1WEgMdoc3Yu4xnTNuLNi/e tOVbHcODi9/HbVINoUz/E3tjUNYLAkA2PI2LUzEEG5cfqAwiNENiOsImtWIr+ntQqQ0D hA5Q== MIME-Version: 1.0 X-Received: by 10.202.194.9 with SMTP id s9mr6305547oif.56.1442667052003; Sat, 19 Sep 2015 05:50:52 -0700 (PDT) Received: by 10.202.240.134 with HTTP; Sat, 19 Sep 2015 05:50:51 -0700 (PDT) Received: by 10.202.240.134 with HTTP; Sat, 19 Sep 2015 05:50:51 -0700 (PDT) In-Reply-To: References: Date: Sat, 19 Sep 2015 18:20:51 +0530 Message-ID: Subject: Re: issue about enable UseNUMA flag in hadoop framework From: Shashikiran Bhat To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a113dc33429fedf0520191988 --001a113dc33429fedf0520191988 Content-Type: text/plain; charset=UTF-8 Ko o, On Sep 19, 2015 2:12 PM, "Zhudacai" wrote: > Hi,ALL > > > > We get a problem about enable UseNUMA flag for my hadoop framework. > > > > We've tried to specify JVM flags during hadoop daemon's starts, > > e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA > -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS", > > export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA > -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc. > > But the ratio between local and remote memory access is 2:1, just remains > as same as before. > > > > Then we find that hadoop MapReduce start child JVM processes to run task > in containers. So we passes -XX:+UseNUMA to JVMs by set theting > configuration parameter child.java.opts. But hadoop starts to throw > ExitCodeExceptionException (exitCode=1), seems that hadoop does not support > this JVM parameter. > > > > What should we do to enable UseNUMA flag for my hadoop? Or what should we > do to decrease the local/remote memory access in NUMA framework? Should we > just change Hadoop script or resorts to source code? And how to do it? > > > > The hadoop version is 2.6.0. > > > > Best Regards. > > > > Dacai > --001a113dc33429fedf0520191988 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Ko o,

On Sep 19, 2015 2:12 PM, "Zhudacai" &l= t;zhudacai@hisilicon.com> = wrote:

Hi,ALL

=C2=A0

We get a problem about enable UseNUMA flag for my h= adoop framework.

=C2=A0

We've tried to specify JVM = flags during hadoop daemon's starts,

e.g. export HADOOP_NAMENODE_OPT= S=3D"-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS= ",

export HADOOP_SECONDARYNAMENODE= _OPTS=3D"-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARY= NAMENODE_OPTS", etc.

But the ratio between local and= remote memory access is 2:1, just remains as same as before.=

=C2=A0

Then we find that hadoop MapRed= uce start child JVM processes to run task in containers. So we passes -XX:+= UseNUMA to JVMs by set theting configuration parameter child.java.opts. But= hadoop starts to throw ExitCodeExceptionException (exitCode=3D1), seems that hadoop does not support this JVM parameter.<= /u>

=C2=A0

What should we do to enable Use= NUMA flag for my hadoop? Or what should we do to decrease the local/remote = memory access in NUMA framework? Should we just change Hadoop script or res= orts to source code? And how to do it?

=C2=A0

The hadoop version is 2.6.0.=

=C2=A0

Best Regards.

=C2=A0

Dacai

--001a113dc33429fedf0520191988--