hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing
Date Thu, 08 Dec 2016 07:08:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731369#comment-15731369

Junping Du commented on YARN-3866:

Thanks for your additional input, Jian! I totally understand what you mean. However, we should
be clear on some following facts:
1. We released this API for years - it is marked as public and stable since very early, you
can found it even at hadoop 2.4: https://hadoop.apache.org/docs/r2.4.1/api/index.html. So
now we cannot claim this is not a completed feature and remove it even it never work as expected
- calling some API with no result is one thing, but calling some API with throw some unhandled
exceptions is another thing. The later one could break the application running.

2. We cannot assume app writer could be very easy to change their applications to adapt our
incompatible changes in 2.8. Some of these applications are third-party software (no matter
open or closed source), and they are already released to their customers. I cannot imagine
one software were using this API (even by unintentionally) by following our official document
and test against any releases prior to 2.8 (like 2.6 or 2.7) works fine, but when end user
upgrade to 2.8, this software will get stuck. If this happens (although less likely), Hadoop
could get blamed as lacking of API compatibility, and user could doubt our released APIs as

3. As I mentioned above, a public released API is a protocol, no matter we use it or not,
we should figure out a proper way/process to retire it. Yarn shouldn't surprise its user in
such way especially as a such success and mature software. :)

More thoughts?


> AM-RM protocol changes to support container resizing
> ----------------------------------------------------
>                 Key: YARN-3866
>                 URL: https://issues.apache.org/jira/browse/YARN-3866
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api
>            Reporter: MENG DING
>            Assignee: MENG DING
>             Fix For: 2.8.0, 3.0.0-alpha1
>         Attachments: YARN-3866-YARN-1197.4.patch, YARN-3866.1.patch, YARN-3866.2.patch,
> YARN-1447 and YARN-1448 are outdated. 
> This ticket deals with AM-RM Protocol changes to support container resize according to
the latest design in YARN-1197.
> 1) Add increase/decrease requests in AllocateRequest
> 2) Get approved increase/decrease requests from RM in AllocateResponse
> 3) Add relevant test cases

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message