hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Wiley <kwi...@keithwiley.com>
Subject Override automatica final streaming job status message?
Date Fri, 04 Feb 2011 22:49:13 GMT
Streaming tasks seem to get a final status message from Hadoop itself (not my code) that reports
"R/W", presumably the number of records read and written (the number of lines of text I assume).
 Problem is, I like to display a final status message for my tasks.  That way I can quickly
glance at a list of hundreds of mappers on the job tracker and see a broad survey of their
final statuses.  This works fine in an all-
Java job, but in streaming, this R/W status is automatically generated, thus overwriting my
final status.

Is there anything I can do about this?

Thank you.

Keith Wiley               kwiley@keithwiley.com               www.keithwiley.com

"And what if we picked the wrong religion?  Every week, we're just making God
madder and madder!"
  -- Homer Simpson

View raw message