hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Erik Krogen (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-13272) DataNodeHttpServer to have configurable HttpServer2 threads
Date Mon, 23 Apr 2018 23:00:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16448993#comment-16448993
] 

Erik Krogen edited comment on HDFS-13272 at 4/23/18 10:59 PM:
--------------------------------------------------------------

Sounds good to me. I have patches put together for both branch-2 and trunk, but given that
they do very different things (one is adding a new config, one is just reducing the value
used), I have created a separate JIRA for the second: HDFS-13493. I have attached the branch-2
patch here. I marked the new config as {{@Deprecated}} given that it is removed in Hadoop
3.

Edit: Actually, I realized publicizing the new config and marking as deprecated is overkill
considering that it is only used by MiniDFSCluster. I instead added it as an {{@InterfaceAudience.Private}}
config within {{DatanodeHttpServer}} which is just used by {{MiniDFSCluster}}.


was (Author: xkrogen):
Sounds good to me. I have patches put together for both branch-2 and trunk, but given that
they do very different things (one is adding a new config, one is just reducing the value
used), I have created a separate JIRA for the second: HDFS-13493. I have attached the branch-2
patch here. I marked the new config as {{@Deprecated}} given that it is removed in Hadoop
3.

> DataNodeHttpServer to have configurable HttpServer2 threads
> -----------------------------------------------------------
>
>                 Key: HDFS-13272
>                 URL: https://issues.apache.org/jira/browse/HDFS-13272
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Erik Krogen
>            Assignee: Erik Krogen
>            Priority: Major
>         Attachments: HDFS-13272-branch-2.000.patch, HDFS-13272-branch-2.001.patch
>
>
> In HDFS-7279, the Jetty server on the DataNode was hard-coded to use 10 threads. In addition
to the possibility of this being too few threads, it is much higher than necessary in resource
constrained environments such as MiniDFSCluster. To avoid compatibility issues, rather than
using {{HttpServer2#HTTP_MAX_THREADS}} directly, we can introduce a new configuration for
the DataNode's thread pool size.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message