hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Moved: (MAPREDUCE-1770) have option to limit stderr output from user scripts in hadoop streaming
Date Fri, 07 May 2010 05:19:48 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amareshwari Sriramadasu moved HADOOP-3984 to MAPREDUCE-1770:
------------------------------------------------------------

              Project: Hadoop Map/Reduce  (was: Hadoop Common)
                  Key: MAPREDUCE-1770  (was: HADOOP-3984)
    Affects Version/s:     (was: 0.17.2)

> have option to limit stderr output from user scripts in hadoop streaming
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1770
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1770
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Joydeep Sen Sarma
>
> People often echo to stderr to debug their programs.  We have had cases where someone
inadvertently dumped large amounts of data to stderr. this created large userlog directories
and caused quite a few mapred slaves to become dysfunctional (logs partition was full).
> Hence looking for a defensive measure against such errant scripts. We are currently putting
in a limit on the number of bytes from the script's stderr that are forwarded to System.err.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message