hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-443) allow OS scheduling priority of NM to be different than the containers it launches
Date Thu, 07 Mar 2013 18:44:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13596169#comment-13596169
] 

Thomas Graves commented on YARN-443:
------------------------------------

Thanks for the review Bikas, I'll remove the bits for modifying the windows stuff and update
based on your comments.  I agree, I wish it was more common but didn't want to take that on
here.

I can update the comment to say higher values mean less favorable priority on Linux.  We could
make that the standard if windows wants to handle converting that.  I changed the name to
be the adjustment, one because it fit as parameter to nice but also in an attempt to make
it less platform specific.  I was hoping it would allows us to say things like positive numbers
in adjustment on any platform make the container run less favorable to NM and then each platform
could interpret that.  We don't have to state that now though.

It doesn't necessarily have to be +ve either.  If you nodemanager has root priveleges it can
be negative on linux although I don't know of anyone who would do that.  I also didn't want
to restrict that for other platforms.
                
> allow OS scheduling priority of NM to be different than the containers it launches
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-443
>                 URL: https://issues.apache.org/jira/browse/YARN-443
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.0.3-alpha, 0.23.6
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>         Attachments: YARN-443-branch-0.23.patch, YARN-443-branch-0.23.patch, YARN-443-branch-2.patch,
YARN-443.patch, YARN-443.patch, YARN-443.patch, YARN-443.patch
>
>
> It would be nice if we could have the nodemanager run at a different OS scheduling priority
than the containers so that you can still communicate with the nodemanager if the containers
out of control.  
> On linux we could launch the nodemanager at a higher priority, but then all the containers
it launches would also be at that higher priority, so we need a way for the container executor
to launch them at a lower priority.
> I'm not sure how this applies to windows if at all.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message