hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bikash sharma <sharmabiks...@gmail.com>
Subject Re: hadoop parameters config files location
Date Mon, 04 Apr 2011 20:02:47 GMT
Thanks Harsh.

On Mon, Apr 4, 2011 at 3:33 PM, Harsh Chouraria <harsh@cloudera.com> wrote:

> Hello,
>
> On Tue, Apr 5, 2011 at 12:52 AM, bikash sharma <sharmabiks.07@gmail.com>
> wrote:
> > Hi,
> > I want to change the following hadoop parameters before launching
> TeraSort
> > program:
> > io.sort.factor
> > io.sort.mb
> > mapreduce.reduce.tasks
> > io.file.buffer.size
> > io.sort.record.percent
>
> Making these changes in the mapred-site.xml should be fine.
>
> As a lazy fix, set all those property changes as <final>true</final>.
> This would enforce it over the defaults that are being used instead.
> [1]'s probably why it doesn't get picked up.
>
> Or pass generic options (with -Dprop=val) while launching the program,
> if it accepts that.
>
> [1] -
> http://wiki.apache.org/hadoop/FAQ#How_do_I_get_my_MapReduce_Java_Program_to_read_the_Cluster.27s_set_configuration_and_not_just_defaults.3F
>
> --
> Harsh J
> Support Engineer, Cloudera
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message