Return-Path: Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: (qmail 86499 invoked from network); 4 Apr 2011 19:34:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Apr 2011 19:34:19 -0000 Received: (qmail 36896 invoked by uid 500); 4 Apr 2011 19:34:18 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 36700 invoked by uid 500); 4 Apr 2011 19:34:17 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 36692 invoked by uid 99); 4 Apr 2011 19:34:17 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 19:34:17 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.216.48 as permitted sender) Received: from [209.85.216.48] (HELO mail-qw0-f48.google.com) (209.85.216.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 19:34:10 +0000 Received: by qwj9 with SMTP id 9so4750295qwj.35 for ; Mon, 04 Apr 2011 12:33:49 -0700 (PDT) Received: by 10.224.196.131 with SMTP id eg3mr5839219qab.375.1301945629108; Mon, 04 Apr 2011 12:33:49 -0700 (PDT) MIME-Version: 1.0 Received: by 10.224.37.135 with HTTP; Mon, 4 Apr 2011 12:33:29 -0700 (PDT) In-Reply-To: References: From: Harsh Chouraria Date: Tue, 5 Apr 2011 01:03:29 +0530 Message-ID: Subject: Re: hadoop parameters config files location To: common-dev@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Hello, On Tue, Apr 5, 2011 at 12:52 AM, bikash sharma wrote: > Hi, > I want to change the following hadoop parameters before launching TeraSort > program: > io.sort.factor > io.sort.mb > mapreduce.reduce.tasks > io.file.buffer.size > io.sort.record.percent Making these changes in the mapred-site.xml should be fine. As a lazy fix, set all those property changes as true. This would enforce it over the defaults that are being used instead. [1]'s probably why it doesn't get picked up. Or pass generic options (with -Dprop=val) while launching the program, if it accepts that. [1] - http://wiki.apache.org/hadoop/FAQ#How_do_I_get_my_MapReduce_Java_Program_to_read_the_Cluster.27s_set_configuration_and_not_just_defaults.3F -- Harsh J Support Engineer, Cloudera