Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F04A810D47 for ; Wed, 4 Dec 2013 01:57:44 +0000 (UTC) Received: (qmail 76674 invoked by uid 500); 4 Dec 2013 01:57:40 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 76443 invoked by uid 500); 4 Dec 2013 01:57:40 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 76436 invoked by uid 99); 4 Dec 2013 01:57:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Dec 2013 01:57:40 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=HTML_FONT_FACE_BAD,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of azuryyyu@gmail.com designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vc0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Dec 2013 01:57:34 +0000 Received: by mail-vc0-f176.google.com with SMTP id lf12so10749583vcb.35 for ; Tue, 03 Dec 2013 17:57:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Pboy+5gTocWYrEXsvDlE28SVctTBjsyxO+xjbjzJHjY=; b=p8+JKpHAiymRmwx/hbWpNZpYKlQSds3iCm1GVPlmvTVitszYudCJwVnR89AsCPrkSe lZ3nQKV4GSFPBzNUKmji+YETkqcK9Gwe8ilS/tStLMEoQQ75roXVk1WC6u+q6puDmWYP nVrfUGBAuAWKWG1FRfNPpZWZOIwfwXlg9h6yz4CUPZg9xz7vhFx8CfDVdcfD+dnR3nBS NROcpRJLmWVBk5PRif9FHSDR+1cYcO2LgqUtFpBbHDh1ayR5xRPrO+PCMpTjGY9UF0vk 9nzD8vQrt6DdKRfVJHBTRyHSbkxSN6fAm7k4epA8Dp/gHAMbPzEMtEcAbdRCvirjce7Y 9/CA== MIME-Version: 1.0 X-Received: by 10.58.255.71 with SMTP id ao7mr57977285ved.16.1386122233719; Tue, 03 Dec 2013 17:57:13 -0800 (PST) Received: by 10.220.4.135 with HTTP; Tue, 3 Dec 2013 17:57:13 -0800 (PST) In-Reply-To: References: Date: Wed, 4 Dec 2013 09:57:13 +0800 Message-ID: Subject: Re: Perfect configuration setting From: Azuryy Yu To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bf0d1b45b5ff204ecabbbd7 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bf0d1b45b5ff204ecabbbd7 Content-Type: text/plain; charset=ISO-8859-1 Sandy, I can access it now. but I do failed many times before I reply your mail. Thanks. On Wed, Dec 4, 2013 at 9:49 AM, Sandy Ryza wrote: > Weird. I just tried exiting the Cloudera VPN and opening it from a > browser I never use and was still able to access it. > > > On Tue, Dec 3, 2013 at 5:46 PM, Azuryy Yu wrote: > >> Hi Sandy, >> I think there are some permission limited on your shared URL. maybe only >> Cloudera employees allowed. >> >> >> On Tue, Dec 3, 2013 at 4:26 PM, Sandy Ryza wrote: >> >>> Hi Geelong, >>> >>> Check out Todd Lipcon's presentation on tuning MapReduce performance: >>> http://www.slideshare.net/cloudera/mr-perf >>> >>> -Sandy >>> >>> >>> On Mon, Dec 2, 2013 at 11:14 PM, Geelong Yao wrote: >>> >>>> Hi Everyone >>>> >>>> I am now testing the best performance of my cluster >>>> Can anyone give me some *formulas or suggestion* for all setting >>>> values in MR program? >>>> eg. >>>> io.sort.mb >>>> io.sort.spill.percent >>>> mapred.local.dir >>>> mapred.child.java.opts etc. >>>> >>>> Any details would be great >>>> >>>> BRs >>>> Geelong >>>> >>>> -- >>>> From Good To Great >>>> >>> >>> >> > --047d7bf0d1b45b5ff204ecabbbd7 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Sandy, I can access it now. but I do failed many times bef= ore I reply your mail. Thanks.


On Wed, Dec 4, 2013 at 9:49 AM, Sandy Ryza <s= andy.ryza@cloudera.com> wrote:
Weird. =A0I just tried exit= ing the Cloudera VPN and opening it from a browser I never use and was stil= l able to access it.


=
On Tue, Dec 3, 2013 at 5:46 PM, Azuryy Yu <azu= ryyyu@gmail.com> wrote:
Hi Sandy,=A0
I think the= re are some permission limited on your shared URL. maybe only Cloudera empl= oyees allowed.


On = Tue, Dec 3, 2013 at 4:26 PM, Sandy Ryza <sandy.ryza@cloudera.com= > wrote:
Hi Geelong,

<= div>Check out Todd Lipcon's presentation on tuning MapReduce performanc= e:=A0http://www.slideshare.net/cloudera/mr-perf

-Sandy


On Mon, Dec 2, 2013 at 11:= 14 PM, Geelong Yao <geelongyao@gmail.com> wrote:
Hi Everyone

<= div>I am now testing the best performance of my cluster
Can anyon= e give me some formulas or suggestion for all setting values in MR p= rogram?
eg.
io.sort.mb
io.sort.spill.percent
mapred.local.dir
= mapred.child.java.opts =A0=A0etc.

Any details would be grea= t

BRs
Geelong

--
From Good To Great




--047d7bf0d1b45b5ff204ecabbbd7--