hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ilyal levin <nipponil...@gmail.com>
Subject Stop chained mapreduce.
Date Sun, 11 Sep 2011 11:52:34 GMT
Hi
I created a chained mapreduce program where each job creates a SequenceFile
output.
My stopping condition is simply to check if the last output file (Type -
SequenceFile) is empty.
In order to do that i need to use the SequenceFile.Reader
and for him to read the data i need the path of the output file. The problem
is that i don't know the name of the file,
it usually depends on the number of the reducer. What can i do to solve
this?

Thanks.

Mime
View raw message