hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Venner <ja...@attributor.com>
Subject Request for Hadoop metrics and making emitRecords public
Date Thu, 06 Mar 2008 23:53:08 GMT
We have operations that need to force the metric records out at a 
specific point in time. We want to emit the complete task counter 
records after JobClient.runJob, and the jvm has a limited life after 
that point, and our metrics records are not being emitted.

Currently the emitRecords call is only made from within the timeout 
handler, and is private.

What do people thing of opening up the interface to allow applications 
to force an output.

I originally would have added a flush method, but the way that is used 
is not relevant to this problem. flush expects emitRecords to have been 
called and flushes the emitted data to the destination.


Jason Venner
Attributor - Publish with Confidence <http://www.attributor.com/>
Attributor is hiring Hadoop Wranglers, contact if interested

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message