Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CFCC4101D8 for ; Fri, 30 Aug 2013 03:54:11 +0000 (UTC) Received: (qmail 81708 invoked by uid 500); 30 Aug 2013 03:54:03 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 81214 invoked by uid 500); 30 Aug 2013 03:54:01 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 80733 invoked by uid 99); 30 Aug 2013 03:54:00 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Aug 2013 03:54:00 +0000 Received: from localhost (HELO [10.0.0.4]) (127.0.0.1) (smtp-auth username hitesh, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Aug 2013 03:54:00 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1085) Subject: Re: Hadoop Yarn From: Hitesh Shah In-Reply-To: Date: Thu, 29 Aug 2013 20:53:59 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: References: <1BB54131-CFCD-4545-B397-6168860FCB57@apache.org> To: user@hadoop.apache.org X-Mailer: Apple Mail (2.1085) Hi Rajesh, Have you looked at re-using the profiling options to inject the jvm = options to a defined range of tasks? = http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Profiling -- Hitesh On Aug 29, 2013, at 3:51 PM, Rajesh Jain wrote: > Hi Vinod >=20 > These are jvm parameters to inject agent only on some nodes for = sampling.=20 >=20 > Is there a property because code change is not a option.=20 >=20 > Second is there a way to tell the jvms how much data size to process.=20= >=20 > Thanks >=20 > Sent from my iPhone >=20 > On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli = wrote: >=20 >>=20 >> You'll have to change the MapReduce code. What options are you = exactly looking for and why should they be only applied on some nodes? = Some kind of sampling? >>=20 >> More details can help us help you. >>=20 >> Thanks, >> +Vinod Kumar Vavilapalli >> Hortonworks Inc. >> http://hortonworks.com/ >>=20 >> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote: >>=20 >>> I have some jvm options which i want to configure only for a few = nodes in the cluster using Hadoop yarn. How do i di it. If i edit the = mapred-site.xml it gets applied to all the task jvms. I just want = handful of map jvms to have that option and other map jvm not have that = options.=20 >>>=20 >>> Thanks >>> Rajesh >>>=20 >>> Sent from my iPhone >>=20 >>=20 >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or = entity to which it is addressed and may contain information that is = confidential, privileged and exempt from disclosure under applicable = law. If the reader of this message is not the intended recipient, you = are hereby notified that any printing, copying, dissemination, = distribution, disclosure or forwarding of this communication is strictly = prohibited. If you have received this communication in error, please = contact the sender immediately and delete it from your system. Thank = You. >>