hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Kanter (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout
Date Mon, 14 Aug 2017 18:41:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126194#comment-16126194
] 

Robert Kanter commented on YARN-5536:
-------------------------------------

To put a few more details on the work required here from the comments in YARN-5464 (the JIRA
doesn't say much), as I understand it:
# Remove the XML format as-is
# Make the input format pluggable, similar to HDFS-9005
# Add a JSON format that is compatible with HDFS-9005 so users can use the same file for both

Is that correct [~mingma]?

This is currently a blocker for Hadoop 3 beta 1. [~mingma] do you think you'll be able to
take care of this in time? The [Hadoop 3 release wiki page|https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0.0+Release]
says that we only have about a month left.

If not, we have a couple faster options we can do in the meantime to make this not a blocker:
# If we plan to keep the XML format when doing this, it won't be backwards incompatible anymore.
 We can still rewrite the code to be in the pluggable implementation, but we'd have to keep
the same XML format itself.
# We could remove the XML format now (so we'd only have the original format), and do the rest
of this work later.  Users won't be able to specify individual different timeouts per host
in the meantime though.

I think if we do one of those, then we can take care of this issue later if we don't have
time to take care of it now for beta 1.

> Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission
with timeout
> ---------------------------------------------------------------------------------------------------
>
>                 Key: YARN-5536
>                 URL: https://issues.apache.org/jira/browse/YARN-5536
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: graceful
>            Reporter: Junping Du
>            Priority: Blocker
>
> Per discussion in YARN-4676, we agree that multiple format (other than xml) should be
supported to decommission nodes with timeout values.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message