hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4814) Configurable DataXceiver thread stack size
Date Sat, 11 May 2013 20:47:16 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13655368#comment-13655368

Tsz Wo (Nicholas), SZE commented on HDFS-4814:

Todd, thanks for the input.  I will test it.

> ... I think most folks are running 64-bit JVMs these days, so the address space savings
doesn't seem too critical to me.

We did see OOM in some 32-bit JVMs.
> Configurable DataXceiver thread stack size
> ------------------------------------------
>                 Key: HDFS-4814
>                 URL: https://issues.apache.org/jira/browse/HDFS-4814
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: datanode
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: h4814_20130510.patch
> By default, Java creates a thread with 512kB stack size.  In Datanode, we may have 4096
or more DataXceiver threads.  These threads do not require such large stack size and unnecessarily
occupy a large amount of memory.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message