hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mefa Grut <mefag...@gmail.com>
Subject MapReduce tasks cleanup
Date Tue, 10 Jan 2012 13:08:50 GMT
Two cleanup related questions:
Can I execute context.write from the reduce/map cleanup phase?
Should I expect cleanup to be killed when a task fail or killed(speculative
execution)?
The idea is to update HBase counters from within mapreduce job (kind of
alternative to the builtin mapreduce counters that can scale to millions of
counters).
Since tak can fail and run again or be duplicated and killed  events can be
incremented too many times. How Hadoop workaround this problem with the
generic counters?
Tx,
Mefa

Mime
View raw message