hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Charles Baker" <cba...@sdl.com>
Subject RE: Question about
Date Thu, 13 Sep 2012 00:56:13 GMT
Hi Vivian. Take a look at TextInputFormat and the RecordReader classes. This
is set via JobConf.setInputFormat().


-----Original Message-----
From: Vivi Lang [mailto:sqlxweiwei@gmail.com] 
Sent: Wednesday, September 12, 2012 5:10 PM
To: hdfs-dev@hadoop.apache.org
Subject: Question about

Hi all,

Is there anyone who can tell me that when we lanuch a mapreduce task, for
example, wordcount, after the JobClient obtained the block locations (the
related hosts/datanodes are stored in the specified split), which
function/class will be called for reading those blocks from the datanode?

SDL Enterprise Technologies, Inc. - all rights reserved.  The information contained in this
email may be confidential and/or legally privileged. It has been sent for the sole use of
the intended recipient(s). If you are not the intended recipient of this mail, you are hereby
notified that any unauthorized review, use, disclosure, dissemination, distribution, or copying
of this communication, or any of its contents, is strictly prohibited. If you have received
this communication in error, please reply to the sender and destroy all copies of the message.
Registered address: 69 Hickory Drive, 3rd Floor, Waltham, MA 02451, USA

View raw message