hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh Chouraria <ha...@cloudera.com>
Subject Re: hadoop parameters config files location
Date Mon, 04 Apr 2011 19:33:29 GMT

On Tue, Apr 5, 2011 at 12:52 AM, bikash sharma <sharmabiks.07@gmail.com> wrote:
> Hi,
> I want to change the following hadoop parameters before launching TeraSort
> program:
> io.sort.factor
> io.sort.mb
> mapreduce.reduce.tasks
> io.file.buffer.size
> io.sort.record.percent

Making these changes in the mapred-site.xml should be fine.

As a lazy fix, set all those property changes as <final>true</final>.
This would enforce it over the defaults that are being used instead.
[1]'s probably why it doesn't get picked up.

Or pass generic options (with -Dprop=val) while launching the program,
if it accepts that.

[1] - http://wiki.apache.org/hadoop/FAQ#How_do_I_get_my_MapReduce_Java_Program_to_read_the_Cluster.27s_set_configuration_and_not_just_defaults.3F

Harsh J
Support Engineer, Cloudera

View raw message