tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-3952) Allow Tez task speculation to grant greater customization of certain parameters
Date Fri, 15 Feb 2019 23:08:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769836#comment-16769836
] 

Jonathan Eagles commented on TEZ-3952:
--------------------------------------

+1. Going to cleanup white space and checkstyle issues in a separate JIRA to make sure credit
for this patch is given to the assignee.

> Allow Tez task speculation to grant greater customization of certain parameters
> -------------------------------------------------------------------------------
>
>                 Key: TEZ-3952
>                 URL: https://issues.apache.org/jira/browse/TEZ-3952
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Nishant Dash
>            Assignee: Nishant Dash
>            Priority: Major
>         Attachments: TEZ-3952.001.patch, TEZ-3952.002.patch, TEZ-3952.003.patch, TEZ-3952.004.patch,
TEZ-3952.005.patch, TEZ-3952.006.patch
>
>
> Many of the settings for Tez task speculation are hardcoded and should instead be configurable.
For example, there's no equivalent config settings for the following MapReduce settings:
> - mapreduce.job.speculative.speculative-cap-running-tasks
> - mapreduce.job.speculative.retry-after-no-speculate
> - mapreduce.job.speculative.retry-after-speculate
> - mapreduce.job.speculative.minimum-allowed-tasks
> - mapreduce.job.speculative.speculative-cap-total-tasks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message