hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron Kimball <aa...@cloudera.com>
Subject Re: Specifying System Properties in the had
Date Thu, 30 Apr 2009 14:25:49 GMT
So you want a different "-Dfoo=test" on each node? It's probably grabbing
the setting from the node where the job was submitted, and this overrides
the settings on each task node.

Try adding <final>true</final> to the <property> block on the tasktrackers,
then restart Hadoop and try again. This will prevent the job from overriding
the setting.

- Aaron

On Thu, Apr 30, 2009 at 9:25 AM, Marc Limotte <mlimotte@feeva.com> wrote:

> I'm trying to set a System Property in the Hadoop config, so my jobs will
> know which cluster they are running on.  I think I should be able to do this
> with -Dname=value in "mapred.child.java.opts" (example below), but the
> setting is ignored.
> In hadoop-site.xml I have:
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx200m -Dfoo=test</value>
> </property>
> But the job conf through the web server indicates:
> mapred.child.java.opts -Xmx1024M -Duser.timezone=UTC
>
> I'm using Hadoop-0.17.2.1.
> Any tips on why my setting is not picked up?
>
> Marc
>
> ________________________________
> PRIVATE AND CONFIDENTIAL - NOTICE TO RECIPIENT: THIS E-MAIL IS MEANT FOR
> ONLY THE INTENDED RECIPIENT OF THE TRANSMISSION, AND MAY BE A COMMUNICATION
> PRIVILEGE BY LAW. IF YOU RECEIVED THIS E-MAIL IN ERROR, ANY REVIEW, USE,
> DISSEMINATION, DISTRIBUTION, OR COPYING OF THIS EMAIL IS STRICTLY
> PROHIBITED. PLEASE NOTIFY US IMMEDIATELY OF THE ERROR BY RETURN E-MAIL AND
> PLEASE DELETE THIS MESSAGE FROM YOUR SYSTEM.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message