hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From AnilKumar B <akumarb2...@gmail.com>
Subject Re: When speculative execution is true, there is a data loss issue with multpleoutputs
Date Wed, 21 Nov 2012 15:07:22 GMT
Thanks Radim.

Yes, as you said we are not writing into sub-directory of main job. I will
try by making them as sub-directories of output dir.

But one question, when I turn of speculative execution then it is working
fine with same multiple output directory structure. May I know, how exactly
it working in this case?

When we change the speculative execution flag, why exactly there is a
difference in output data?

B Anil Kumar.

On Wed, Nov 21, 2012 at 8:01 PM, Radim Kolar <hsn@filez.com> wrote:

> its not data loss, problem is caused that multipleoutputs do not work with
> standard committer if you do not write into subdirectory of main job output.

View raw message