Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8FB5E1004A for ; Wed, 4 Sep 2013 06:09:42 +0000 (UTC) Received: (qmail 31985 invoked by uid 500); 4 Sep 2013 06:09:37 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 31893 invoked by uid 500); 4 Sep 2013 06:09:37 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 31881 invoked by uid 99); 4 Sep 2013 06:09:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Sep 2013 06:09:37 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.214.177 as permitted sender) Received: from [209.85.214.177] (HELO mail-ob0-f177.google.com) (209.85.214.177) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Sep 2013 06:09:32 +0000 Received: by mail-ob0-f177.google.com with SMTP id f8so6896933obp.36 for ; Tue, 03 Sep 2013 23:09:12 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=WKNS1L4vvngNQZNJrAy5AEcZB9m+mNK2O/D8aymWs74=; b=b+gQ5jH6TcS4oojcWZ9v6Sb3wkJObGH10naPSAFVFjPKtXHFAsabK6GPTfHp8kJaoY vFgBtdyyzEjDXSsipVx0uiNnqd7NouWW8nUl9AxbxSgMKeGDudY6TIxeqUHyLgnh/qiO cNPmQpfdE5VUYEN1M59Q1BsEal+st8vJI5DLxaVqFUMkD5MEJ3hZKbDjj3baIm30P4cD a7BIRC+oxVyV9mV9RoV3ndOhK1eCvskBmpOhaughRxbXze0lwgflCYhh0VS3cgbtoXya vbs09Wo35QPQuck8LGPbw5uAVi2KRKqm2X3Q0jbeo/82bI4it3BzaukgrpasWY01EON8 6g2g== X-Gm-Message-State: ALoCoQm6ZqcZtHUEJwQdzOUgGYUNkqvvbVfO/uxWSSElhqQozA4FqFBR3zyjgClIhHv1XRK7PKwF X-Received: by 10.182.50.200 with SMTP id e8mr932574obo.35.1378274952129; Tue, 03 Sep 2013 23:09:12 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.95.105 with HTTP; Tue, 3 Sep 2013 23:08:52 -0700 (PDT) In-Reply-To: <1BB54131-CFCD-4545-B397-6168860FCB57@apache.org> References: <1BB54131-CFCD-4545-B397-6168860FCB57@apache.org> From: Harsh J Date: Wed, 4 Sep 2013 11:38:52 +0530 Message-ID: Subject: Re: Hadoop Yarn To: "" Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org This is sorta a regression with YARN+MR2. In MR1 we've had the administrative ability to lock down changes to mapred.child.java.opts on a per node basis, as Tasks would load the TT config and they could supply finalized arguments (controllable per-node when needed). Given the app behavior of MR2, I am not sure if its still a good idea to do, as we wouldn't expect all cluster nodes to even carry the MR config anymore. We could have the NM inspect+inject or override container opts though, thoughts? On Fri, Aug 30, 2013 at 4:07 AM, Vinod Kumar Vavilapalli wrote: > > You'll have to change the MapReduce code. What options are you exactly > looking for and why should they be only applied on some nodes? Some kind of > sampling? > > More details can help us help you. > > Thanks, > +Vinod Kumar Vavilapalli > Hortonworks Inc. > http://hortonworks.com/ > > On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote: > > I have some jvm options which i want to configure only for a few nodes in > the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml > it gets applied to all the task jvms. I just want handful of map jvms to > have that option and other map jvm not have that options. > > Thanks > Rajesh > > Sent from my iPhone > > > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader of > this message is not the intended recipient, you are hereby notified that any > printing, copying, dissemination, distribution, disclosure or forwarding of > this communication is strictly prohibited. If you have received this > communication in error, please contact the sender immediately and delete it > from your system. Thank You. -- Harsh J