hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haibo Chen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6740) Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval
Date Wed, 17 Aug 2016 05:18:20 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Haibo Chen updated MAPREDUCE-6740:
----------------------------------
    Attachment: mapreduce6740.005.patch

Per offline discussion with Karthik, the default value of task progress report interval can
be set to a portion of the value of task timeout. This gets rid of the default value of task
progress interval in MRJobConfig.java. In this patch, the ratio is set to 0.01 so that in
cases where both task report interval and task timeout are not set explicitly, the value of
task progress report defaults to 3000 milliseconds, preserving its current default value.

> Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval
> -------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6740
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6740
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mr-am
>    Affects Versions: 2.8.0
>            Reporter: Haibo Chen
>            Assignee: Haibo Chen
>            Priority: Minor
>         Attachments: mapreduce6740.001.patch, mapreduce6740.002.patch, mapreduce6740.003.patch,
mapreduce6740.004.patch, mapreduce6740.005.patch
>
>
> Mapreduce-6242 makes task status update interval configurable to ease the pressure on
MR AM to process status updates, but it did not ensure that mapreduce.task.timeout is no smaller
than the configured value of task report interval. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message