hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From maha <m...@umail.ucsb.edu>
Subject Check/Compare mappers output
Date Mon, 14 Feb 2011 18:57:03 GMT
Hi all,

  I want to know how can I check/compare mappers key and values.

Example:

  My Mappers have the following to filter documents before being output:

  String doc1;

 if(!doc1.equals("d1"))
    output.collect(new Text('#'+doc1+'#'), new Text('#'+word1.substring(word1.indexOf(',')+1,
word1.indexOf('>'))+'#')); 
		 

 Yet the intermediate output still includes "d1":
#d1#	#1#
#d1#	#2#
#d1#	#1#
#d1#	#5#
#d1#	#3#
......

  I put '#' to see if there was a space or newline included. Any ideas?

Thank you,

Maha
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message