hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dave Marion (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10370) Allow DataNode to be started with numactl
Date Tue, 24 May 2016 20:15:13 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dave Marion updated HDFS-10370:
-------------------------------
    Attachment: HDFS-10370-branch-2.004.patch
                HDFS-10370.004.patch

Updated patches for master and branch-2. Note that I have run the branch-2 patch locally on
a Hadoop 2.6.0 distribution. I have not tested 3.0, so I'm not sure if the code is in the
correct location. One way to test is to enable numactl, set the args to bind the DN process
to a cpu, start the DN and verify with `taskset -pc <pid>`

> Allow DataNode to be started with numactl
> -----------------------------------------
>
>                 Key: HDFS-10370
>                 URL: https://issues.apache.org/jira/browse/HDFS-10370
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Dave Marion
>            Assignee: Dave Marion
>         Attachments: HDFS-10370-1.patch, HDFS-10370-2.patch, HDFS-10370-3.patch, HDFS-10370-branch-2.004.patch,
HDFS-10370.004.patch
>
>
> Allow numactl constraints to be applied to the datanode process. The implementation I
have in mind involves two environment variables (enable and parameters) in the datanode startup
process. Basically, if enabled and numactl exists on the system, then start the java process
using it. Provide a default set of parameters, and allow the user to override the default.
Wiring this up for the non-jsvc use case seems straightforward. Not sure how this can be supported
using jsvc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message