Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of uslatha@gmail.com designates
 209.85.142.187 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:mime-version:content-type;
        b=i4qdbeohznySK5VxH4KrvvA4T1RRoKUGuPAmI8KMU3AhLi2PLZkUulOsQbyD+57Pws
         i9BDPS65THzjKJb06yaQsz+HzAWKacB7NakTkOG9uLU/n1/RVWDS+a0qtkOWME6a66Dh
         B3m1l98iWMm/p2rdzi9gyKHXvAuKq8eUN7wqE=
Message-ID: <72be46b0810051012n4ff2cf09h74031f5fec05498d@mail.gmail.com>
Date: Sun, 5 Oct 2008 22:42:42 +0530
From: Latha <uslatha@gmail.com>
To: core-user@hadoop.apache.org
Subject: How to modify hadoop-wordcount example to display File-wise results.
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_56900_16388223.1223226762383"

------=_Part_56900_16388223.1223226762383
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Greetings!

Hi, Am trying to modify the WordCount.java mentioned at Example: WordCount
v1.0<http://hadoop.apache.org/core/docs/current/mapred_tutorial.html#Example%3A+WordCount+v1.0>at
http://hadoop.apache.org/core/docs/current/mapred_tutorial.html
Would like to have output the following way,

FileOne    word1  itsCount
FileOne    word2  itsCount
  ..(and so on)
FileTwo    word1  itsCount
FileTwo    wordx  its Count
 ..
FileThree  word1 its Count
 ..

Am trying to do following changes to the code of WordCount.java

1)  private Text filename = new Text();  // Added this to Map class .Not
sure if I would have access to filename here.
2)  (line 18)OutputCollector<Text, Text, IntWritable> output  // Changed the
argument in the map() function to have another Text field.
3)  (line 23) output.collect(filename, word , one); // Trying to change the
output format as 'filename word count'

Am not sure what other changes are to be affected to achieve the required
output. filename is not available to the map method.
My requirement is to go through all the data available in hdfs and prepare
an index file with < filename word count>  format.
Could you please throw light on how I can achieve this.

Thankyou
Srilatha

------=_Part_56900_16388223.1223226762383--