hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sameer Paranjpye (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1328) Hadoop Streaming needs to provide a way for the stream plugin to update global counters
Date Tue, 15 May 2007 19:46:16 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sameer Paranjpye updated HADOOP-1328:
-------------------------------------

    Component/s: contrib/streaming
       Assignee: Owen O'Malley
    Description: 
Sometimes, the stream plugin may want to create/update its own global counters.
There is no way to do so currently.
One possible way to enable that is to use the stderr output of the stream process.
The stream process can emit the global counter update information (such as GLOCAL_COUNTER
COUNTER_NAME NUM)
to the stderr of the process. The Stderr handling thread can call the global counter API whenever
it encounters the global counter update information line.


  was:

Sometimes, the stream plugin may want to create/update its own global counters.
There is no way to do so currently.
One possible way to enable that is to use the stderr output of the stream process.
The stream process can emit the global counter update information (such as GLOCAL_COUNTER
COUNTER_NAME NUM)
to the stderr of the process. The Stderr handling thread can call the global counter API whenever
it encounters the global counter update information line.



> Hadoop Streaming needs to provide a way for the stream plugin to update global counters
> ---------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1328
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1328
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: contrib/streaming
>            Reporter: Runping Qi
>         Assigned To: Owen O'Malley
>
> Sometimes, the stream plugin may want to create/update its own global counters.
> There is no way to do so currently.
> One possible way to enable that is to use the stderr output of the stream process.
> The stream process can emit the global counter update information (such as GLOCAL_COUNTER
COUNTER_NAME NUM)
> to the stderr of the process. The Stderr handling thread can call the global counter
API whenever it encounters the global counter update information line.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message