pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "pi song" <pi.so...@gmail.com>
Subject Question about PigMapReduce
Date Thu, 03 Apr 2008 13:18:53 GMT
In PigMapReduce.run(RecordReader input, OutputCollector output, Reporter
reporter), as I can see, Pig does create its own OutputCollector and write
output to its own files (using PigWriter).
How does the shuffle process work if the files aren't created from the
outputCollector supplied in run(RecordReader input, OutputCollector output,
Reporter reporter)? Do we just put the output files to the location where
shuffle expects?

Thanks for explanation in advance,

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message