hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Libo Yu <yu_l...@hotmail.com>
Subject RE: how to customize hadoop configuration for a job?
Date Wed, 02 Apr 2014 12:55:28 GMT
if I remove the space, that will set system property. I pretty much followed the "
Hadoop: The definitive guide".

From: mshi@gopivotal.com
Date: Wed, 2 Apr 2014 10:14:47 +0800
Subject: Re: how to customize hadoop configuration for a job?
To: user@hadoop.apache.org

Hi Libo,
Could you post the exact command you run? Meanwhile, could you try to remove the space between
-D and the "property=value", i.e. use -Dproperty=value instead of "-D property=value".

On Wed, Apr 2, 2014 at 9:48 AM, Libo Yu <yu_libo@hotmail.com> wrote:

Hi all,

According to the book "Hadoop; The Definitive Guide", it is possible to use "-D property=value"
override any default or site property in the configuration.  

I gave it shot and it is true. The property specified with "-D" is ignored. 

Then I put the property in an xml file and use "-conf xml_name" on the command line. But still
I cannot 
override the property. 

The only way to override the default property is to get a Configuration reference in the code
and set the property 
via the reference. But that is not convenient as I need to recompile the code each time I
change the property.  

So what is the right way to customize the configuration for a job?





View raw message