hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mingjiang Shi <m...@gopivotal.com>
Subject Re: how to customize hadoop configuration for a job?
Date Wed, 02 Apr 2014 02:14:47 GMT
Hi Libo,
Could you post the exact command you run? Meanwhile, could you try to
remove the space between -D and the "property=value", i.e. use
-Dproperty=value instead of "-D property=value".


On Wed, Apr 2, 2014 at 9:48 AM, Libo Yu <yu_libo@hotmail.com> wrote:

> Hi all,
>
> According to the book "Hadoop; The Definitive Guide", it is possible to
> use "-D property=value" to
> override any default or site property in the configuration.
>
> I gave it shot and it is true. The property specified with "-D" is
> ignored.
>
> Then I put the property in an xml file and use "-conf xml_name" on the
> command line. But still I cannot
> override the property.
>
> The only way to override the default property is to get a Configuration
> reference in the code and set the property
> via the reference. But that is not convenient as I need to recompile the
> code each time I change the property.
> So what is the right way to customize the configuration for a job?
>
> Thanks,
>
> Libo
>
>


-- 
Cheers
-MJ

Mime
View raw message