hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1328) Hadoop Streaming needs to provide a way for the stream plugin to update global counters
Date Tue, 17 Jun 2008 08:59:45 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Devaraj Das updated HADOOP-1328:

    Release Note: Introduces a way for the streaming process to update global counters and
status. A streaming process can use the stderr to emit counter information. reporter:counter:<group>,<counter>,<amount>
can be used to update a counter. And to set a status, reporter:status:<message> can
be used.

> Hadoop Streaming needs to provide a way for the stream plugin to update global counters
> ---------------------------------------------------------------------------------------
>                 Key: HADOOP-1328
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1328
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/streaming
>            Reporter: Runping Qi
>            Assignee: Tom White
>             Fix For: 0.18.0
>         Attachments: hadoop-1328-v2.patch, hadoop-1328-v3.patch, hadoop-1328-v4.patch,
hadoop-1328-v5.patch, hadoop-1328.patch
> Sometimes, the stream plugin may want to create/update its own global counters.
> There is no way to do so currently.
> One possible way to enable that is to use the stderr output of the stream process.
> The stream process can emit the global counter update information (such as GLOCAL_COUNTER
> to the stderr of the process. The Stderr handling thread can call the global counter
API whenever it encounters the global counter update information line.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message