Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BD390D548 for ; Sun, 7 Oct 2012 15:29:47 +0000 (UTC) Received: (qmail 96402 invoked by uid 500); 7 Oct 2012 15:29:42 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 96316 invoked by uid 500); 7 Oct 2012 15:29:42 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 96308 invoked by uid 99); 7 Oct 2012 15:29:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Oct 2012 15:29:42 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of centerqi@gmail.com designates 209.85.223.176 as permitted sender) Received: from [209.85.223.176] (HELO mail-ie0-f176.google.com) (209.85.223.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Oct 2012 15:29:36 +0000 Received: by mail-ie0-f176.google.com with SMTP id k11so8784232iea.35 for ; Sun, 07 Oct 2012 08:29:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=1e0uN2oQChzVQpjCJUEhzON2I11eE7boY90Ou/bZGqU=; b=g9YrPU20m6lfVuse792o7Zu5xQqMh1OBuJPIJN153ytdUbyE2dFeKblW9GnBwiXjIR wjqhicAdr6bMDKktpBPn1DVw/ofZAnLU0+dZLJhjU3GY6TwxOpdF/wRx6tVuhInCGhF8 OcQlqON+8eSlUhuQDCgd+VrGSEMHcMkzkTxkXLvIGKkx/Z+kd5gR1C9l+UbXzbGZvOJW o5zvUfdLP81yBYRqXrEFyKwYAfVbxKUy6YmbYVVo76Wq6o5SvaIHMgx+CtXaNXfiMs+a 5UZ/zqbZ0OZoXqXQ89+I/lyWzEvm5SFH8X4x8vArO+fAq/RoAxYOkHqNfJFD6j5gMUD4 c9ew== Received: by 10.50.47.201 with SMTP id f9mr5829600ign.44.1349623755721; Sun, 07 Oct 2012 08:29:15 -0700 (PDT) MIME-Version: 1.0 Received: by 10.64.20.115 with HTTP; Sun, 7 Oct 2012 08:28:55 -0700 (PDT) In-Reply-To: References: From: centerqi hu Date: Sun, 7 Oct 2012 23:28:55 +0800 Message-ID: Subject: Re: What is the difference between Rack-local map tasks and Data-local map tasks? To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=14dae9340e178a4cb604cb79c478 X-Virus-Checked: Checked by ClamAV on apache.org --14dae9340e178a4cb604cb79c478 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Very good explanation, If there is a way to reduce Rack-local map tasks but can increase the Data-local map tasks , Whether to increase performance=EF=BC=9F 2012/10/7 Michael Segel > Rack local means that while the data isn't local to the node running the > task, it is still on the same rack. > (Its meaningless unless you've set up rack awareness because all of the > machines are on the default rack. ) > > Data local means that the task is running local to the machine that > contains the actual data. > > HTH > > -Mike > > On Oct 7, 2012, at 8:56 AM, centerqi hu wrote: > > > hi all > > When I run "hadoop job -status xxx",Output the following some list. > > Rack-local map tasks=3D124 > Data-local map tasks=3D6 > > What is the difference between Rack-local map tasks and Data-local map > tasks? > -- > centerqi@gmail.com|Sam > > > --=20 centerqi@gmail.com|=E9=BD=90=E5=BF=A0 --14dae9340e178a4cb604cb79c478 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Very good explanation,
If there is a way to reduce=C2=A0Rack-local map = tasks=C2=A0
but can increase the=C2=A0Data-local map tasks=C2=A0,=
Whether to increase performance=EF=BC=9F

2012/10/7 Michael Segel <michael_segel@hotmail.com&= gt;
Rack loc= al means that while the data isn't local to the node running the task, = it is still on the same rack.=C2=A0
(Its meaningless unless you've set up rack awareness because all of the= machines are on the default rack. )

Data local me= ans that the task is running local to the machine that contains the actual = data.=C2=A0

HTH

-Mike

On Oct 7, 2012, at 8:56 AM, centerqi hu <centerqi@gmail.com&= gt; wrote:


hi all
=

When I run "hadoop job -status xxx",Output the following some = list.

Rack-local map tasks=3D124
Data-local map tasks=3D6

What is the difference between Rack-local map tasks and Da= ta-local map tasks?

--
centerqi@gmail.com|Sam




--
centerqi@gmail.com|=E9=BD=90=E5=BF=A0
--14dae9340e178a4cb604cb79c478--