hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1943) Implement limits on per-job JobConf, Counters, StatusReport, Split-Sizes
Date Wed, 14 Jul 2010 21:13:56 GMT
Implement limits on per-job JobConf, Counters, StatusReport, Split-Sizes
------------------------------------------------------------------------

                 Key: MAPREDUCE-1943
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1943
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Mahadev konar
            Assignee: Mahadev konar
             Fix For: 0.22.0


We have come across issues in production clusters wherein users abuse counters, statusreport
messages and split sizes. One such case was when one of the users had 100 million counters.
This leads to jobtracker going out of memory and being unresponsive. In this jira I am proposing
to put sane limits on the status report length, the number of counters and the size of block
locations returned by the input split. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message