hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Vasudev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor
Date Mon, 21 Aug 2017 14:46:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135245#comment-16135245
] 

Varun Vasudev commented on YARN-6623:
-------------------------------------

{quote}


    #define EXECUTOR_PATH_MAX 131072

    This is lots of allocation. The OS actually needs to zero all the allocated memory before
giving it to other processes after close, so this might add to the overall CPU usage and memory
bandwidth.

Given that yarn local dirs are bind mounted into containers, using 4096 has proven problematic
with even a small number of yarn local dirs/disks (3 in the case I saw). We're going to need
to make the size of this buffer configurable. If it seems more appropriate to do so in a separate
issue, I'm fine with that.
{quote}

This got fixed by YARN-6988.

> Add support to turn off launching privileged containers in the container-executor
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-6623
>                 URL: https://issues.apache.org/jira/browse/YARN-6623
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>            Priority: Blocker
>         Attachments: YARN-6623.001.patch, YARN-6623.002.patch, YARN-6623.003.patch, YARN-6623.004.patch,
YARN-6623.005.patch
>
>
> Currently, launching privileged containers is controlled by the NM. We should add a flag
to the container-executor.cfg allowing admins to disable launching privileged containers at
the container-executor level.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message