hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8255) Allow option to disable flex for a service component
Date Tue, 08 May 2018 04:48:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16466857#comment-16466857
] 

Wangda Tan commented on YARN-8255:
----------------------------------

[~eyang], 

Thanks for commenting, your suggestion makes sense, and has less dev/testing overhead. I
think we can do as you suggested: allow flexing when restart-policy  = always / on-failure;
and disallow flexing when restart-policy = never.

We can add a separate allow_flexing flag to spec if once we see solid requirements from users.

[~suma.shivaprasad], does this make sense to you, please feel free to share your opinions.

> Allow option to disable flex for a service component 
> -----------------------------------------------------
>
>                 Key: YARN-8255
>                 URL: https://issues.apache.org/jira/browse/YARN-8255
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn-native-services
>            Reporter: Suma Shivaprasad
>            Assignee: Suma Shivaprasad
>            Priority: Major
>
> YARN-8080 implements restart capabilities for service component instances. YARN service
components should add an option to disallow flexing to support workloads which are essentially
batch/iterative jobs which terminate with restart_policy=NEVER/ON_FAILURE. This could be disabled
by default for components where restart_policy=NEVER/ON_FAILURE and enabled by default when
restart_policy=ALWAYS(which is the default restart_policy) unless explicitly set at the service
spec.
> The option could be exposed as part of the component spec as "allow_flexing". 
> cc [~billie.rinaldi] [~gsaha] [~eyang] [~csingh] [~wangda]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message