Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E317490A7 for ; Thu, 13 Sep 2012 00:56:42 +0000 (UTC) Received: (qmail 8498 invoked by uid 500); 13 Sep 2012 00:56:42 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 8436 invoked by uid 500); 13 Sep 2012 00:56:42 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 8425 invoked by uid 99); 13 Sep 2012 00:56:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Sep 2012 00:56:41 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of prvs=5965eb594=cbaker@sdl.com designates 65.100.157.33 as permitted sender) Received: from [65.100.157.33] (HELO mailus.sdl.com) (65.100.157.33) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Sep 2012 00:56:35 +0000 X-Disclaimer: None X-IronPort-AV: E=Sophos;i="4.80,414,1344207600"; d="scan'208";a="7580547" Received: from usmail0301.global.sdl.corp ([10.32.3.3]) by ushub0301.sdl.corp with Microsoft SMTPSVC(6.0.3790.4675); Wed, 12 Sep 2012 17:56:14 -0700 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Subject: RE: Question about Date: Wed, 12 Sep 2012 18:56:13 -0600 Message-ID: In-Reply-To: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Question about Thread-Index: Ac2RRDI+tRt06r/iTwexfzJokhf/igABAFOA References: From: "Charles Baker" To: X-OriginalArrivalTime: 13 Sep 2012 00:56:14.0221 (UTC) FILETIME=[92ECC3D0:01CD914A] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hi Vivian. Take a look at TextInputFormat and the RecordReader classes. This is set via JobConf.setInputFormat(). -Chuck -----Original Message----- From: Vivi Lang [mailto:sqlxweiwei@gmail.com]=20 Sent: Wednesday, September 12, 2012 5:10 PM To: hdfs-dev@hadoop.apache.org Subject: Question about Hi all, Is there anyone who can tell me that when we lanuch a mapreduce task, for example, wordcount, after the JobClient obtained the block locations (the related hosts/datanodes are stored in the specified split), which function/class will be called for reading those blocks from the datanode? Thanks, Vivian SDL Enterprise Technologies, Inc. - all rights reserved. The information c= ontained in this email may be confidential and/or legally privileged. It ha= s been sent for the sole use of the intended recipient(s). If you are not t= he intended recipient of this mail, you are hereby notified that any unauth= orized review, use, disclosure, dissemination, distribution, or copying of = this communication, or any of its contents, is strictly prohibited. If you = have received this communication in error, please reply to the sender and d= estroy all copies of the message. Registered address: 69 Hickory Drive, 3rd Floor, Waltham, MA 02451, USA