hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3779) Create hard and soft limits for job counters
Date Sun, 17 Mar 2013 06:20:14 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604523#comment-13604523
] 

Harsh J commented on MAPREDUCE-3779:
------------------------------------

Moved from rel-notes:

Ravi quoth:
bq. I'm marking this JIRA as won't fix. We can consider re-opening it if you propose a compelling
use case
                
> Create hard and soft limits for job counters
> --------------------------------------------
>
>                 Key: MAPREDUCE-3779
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3779
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker, tasktracker
>    Affects Versions: 0.23.0, 1.0.0
>            Reporter: Dave Shine
>            Priority: Minor
>
> The mapreduce.job.counters.limit is not overridable at the job level.  While it is necessary
to limit the number of counters to reduce overhead, there are times when exceeding the limit
is required.  Currently, the only solution is to increase the limit cluster wide.
> I would like to see a soft limit set in the mapred-site.xml that can be overridden at
the job level, in addition to the hard limit that exists today.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message