Return-Path: 
 <user-return-12012-apmail-hadoop-hdfs-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 4E5DF10750
	for <apmail-hadoop-hdfs-user-archive@minotaur.apache.org>;
 Tue, 26 Nov 2013 05:37:01 +0000 (UTC)
Received: (qmail 99646 invoked by uid 500); 26 Nov 2013 05:36:52 -0000
Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org
Received: (qmail 99517 invoked by uid 500); 26 Nov 2013 05:36:52 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 99503 invoked by uid 99); 26 Nov 2013 05:36:50 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Nov 2013 05:36:50 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of jezhang@gopivotal.com
 designates 209.85.128.45 as permitted sender)
Received: from [209.85.128.45] (HELO mail-qe0-f45.google.com) (209.85.128.45)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Nov 2013 05:36:41 +0000
Received: by mail-qe0-f45.google.com with SMTP id 6so5041650qea.4
        for <user@hadoop.apache.org>; Mon, 25 Nov 2013 21:36:20 -0800 (PST)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20130820;
        h=x-gm-message-state:mime-version:in-reply-to:references:date
         :message-id:subject:from:to:content-type;
        bh=MrA6BDseMGxDJv4w9nDwxtIVhYeXWcJ6+1TyFbuGH4c=;
        b=e1BaRk+OQHSUJ1DMNxaTL5Q7VDkfVS165SNIIx7xjWU0MMb/hUMLuWdmUtHg9F7b5e
         D5nWe0/vGDgXpWBx85cnXxCWrZwySe526Vnitm1KGpDrT1nVC3H4dFdghXxDt1k6dV1x
         ohwWO3LC4aytffpEAm8G3hbPTAvxSQBLz2W4AGpRkacNZC1Y1DoqzOj35B9s/oDhuNK+
         tY7g+AqFjBsvG3ZfkcZOBUWuNchntp0jdTEk4a1GeZpzpU0/LA3n07/BJz94QC4vGngO
         vJymk/5Z7IE9WqpcvaIc3lvwrchSfjz6gkuPfUb8ZgOnEsxUgxNA3onvEkxp3inUslcM
         PGkA==
X-Gm-Message-State: 
 ALoCoQlW7UrB7RfC7xXoElHQM8NTj5h0+ewmFAu+PU3q44q08giZh3hnIkFYsWvQfIihleLEnXwT
MIME-Version: 1.0
X-Received: by 10.49.130.135 with SMTP id oe7mr52585144qeb.41.1385444180664;
 Mon, 25 Nov 2013 21:36:20 -0800 (PST)
Received: by 10.140.47.202 with HTTP; Mon, 25 Nov 2013 21:36:20 -0800 (PST)
In-Reply-To: 
 <CACeqxwQ7AiFhc_6ZbUCxfuUn-03YC6zgKfmPOjkUjmBwQ9Pg8w@mail.gmail.com>
References: 
 <CACeqxwQ7AiFhc_6ZbUCxfuUn-03YC6zgKfmPOjkUjmBwQ9Pg8w@mail.gmail.com>
Date: Tue, 26 Nov 2013 13:36:20 +0800
Message-ID: 
 <CACCbB6JbM0Lc1ZNT4ZnQNe8swuzPb+ACMhYCHy5FhK_vAM2rVA@mail.gmail.com>
Subject: Re: why my terasort job become a local job?
From: Jeff Zhang <jezhang@gopivotal.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7bd6bc443ebb3004ec0ddc17
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7bd6bc443ebb3004ec0ddc17
Content-Type: text/plain; charset=ISO-8859-1

Do you set to use yarn framework in mapred-site.xml as following ?

  <property>
   <name>mapreduce.framework.name</name>
   <value>yarn</value>
  </property>


On Tue, Nov 26, 2013 at 1:27 PM, ch huang <justlooks@gmail.com> wrote:

> hi,maillist:
>           i run terasort in my hadoop cluster,and it run as a local job,i
> do not know why ,anyone can help?
>
> i use hadoop version is CDH4.4
>
> # sudo -u hdfs hadoop jar
> /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.4.0.jar
> teragen 10000000 /alex/terasort/10G-input
> ......
>
> 13/11/26 11:57:39 INFO mapred.Task:
> Task:attempt_local321416814_0001_m_000000_0 is done. And is in the process
> of commiting
> 13/11/26 11:57:39 INFO mapred.LocalJobRunner:
> 13/11/26 11:57:39 INFO mapred.Task: Task
> attempt_local321416814_0001_m_000000_0 is allowed to commit now
> 13/11/26 11:57:39 INFO mapred.FileOutputCommitter: Saved output of task
> 'attempt_local321416814_0001_m_000000_0' to
> hdfs://product/alex/terasort/10G-input
> 13/11/26 11:57:39 INFO mapred.LocalJobRunner:
> 13/11/26 11:57:39 INFO mapred.Task: Task
> 'attempt_local321416814_0001_m_000000_0' done.
> 13/11/26 11:57:39 INFO mapred.LocalJobRunner: Finishing task:
> attempt_local321416814_0001_m_000000_0
> 13/11/26 11:57:39 INFO mapred.LocalJobRunner: Map task executor complete.
> 13/11/26 11:57:40 INFO mapred.JobClient:  map 100% reduce 0%
> 13/11/26 11:57:40 INFO mapred.JobClient: Job complete:
> job_local321416814_0001
> 13/11/26 11:57:40 INFO mapred.JobClient: Counters: 19
>

--047d7bd6bc443ebb3004ec0ddc17
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Do you set to use yarn framework in mapred-site.xml as fol=
lowing ?<div><br></div><div><div>=A0 &lt;property&gt;</div><div>=A0 =A0&lt;=
name&gt;<a href=3D"http://mapreduce.framework.name">mapreduce.framework.nam=
e</a>&lt;/name&gt;</div>
<div>=A0 =A0&lt;value&gt;yarn&lt;/value&gt;</div><div>=A0 &lt;/property&gt;=
</div></div></div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_qu=
ote">On Tue, Nov 26, 2013 at 1:27 PM, ch huang <span dir=3D"ltr">&lt;<a hre=
f=3D"mailto:justlooks@gmail.com" target=3D"_blank">justlooks@gmail.com</a>&=
gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div>hi,maillist:</div>
<div>=A0=A0=A0=A0=A0=A0=A0=A0=A0 i run terasort in my hadoop cluster,and it=
 run as a local job,i do not know why ,anyone can help?</div>
<div>=A0</div>
<div>i use hadoop version is CDH4.4</div>
<div>=A0</div>
<div># sudo -u hdfs hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-e=
xamples-2.0.0-cdh4.4.0.jar teragen 10000000 /alex/terasort/10G-input<br>...=
...</div>
<div>=A0</div>
<div>13/11/26 11:57:39 INFO mapred.Task: Task:attempt_local321416814_0001_m=
_000000_0 is done. And is in the process of commiting<br>13/11/26 11:57:39 =
INFO mapred.LocalJobRunner:<br>13/11/26 11:57:39 INFO mapred.Task: Task att=
empt_local321416814_0001_m_000000_0 is allowed to commit now<br>

13/11/26 11:57:39 INFO mapred.FileOutputCommitter: Saved output of task &#3=
9;attempt_local321416814_0001_m_000000_0&#39; to hdfs://product/alex/teraso=
rt/10G-input<br>13/11/26 11:57:39 INFO mapred.LocalJobRunner:<br>13/11/26 1=
1:57:39 INFO mapred.Task: Task &#39;attempt_local321416814_0001_m_000000_0&=
#39; done.<br>

13/11/26 11:57:39 INFO mapred.LocalJobRunner: Finishing task: attempt_local=
321416814_0001_m_000000_0<br>13/11/26 11:57:39 INFO mapred.LocalJobRunner: =
Map task executor complete.<br>13/11/26 11:57:40 INFO mapred.JobClient:=A0 =
map 100% reduce 0%<br>

13/11/26 11:57:40 INFO mapred.JobClient: Job complete: job_local321416814_0=
001<br>13/11/26 11:57:40 INFO mapred.JobClient: Counters: 19<br></div>
</blockquote></div><br></div>

--047d7bd6bc443ebb3004ec0ddc17--