hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4814) Configurable DataXceiver thread stack size
Date Mon, 13 May 2013 20:27:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13656339#comment-13656339
] 

Tsz Wo (Nicholas), SZE commented on HDFS-4814:
----------------------------------------------

{noformat}
USER             PID  %CPU %MEM      VSZ    RSS   TT  STAT STARTED      TIME COMMAND
szetszwo         750   0.0  1.4  3219724 242500 s010  S     2:54PM   0:02.83 -d64 TestThreadStackSize
2000 131072
szetszwo         752   0.0  1.4  5010700 242156 s010  S     2:55PM   0:04.67 -d64 TestThreadStackSize
2000 0
szetszwo         770   0.0  0.5  3040668  85924 s010  S     2:58PM   0:03.76 -d32 TestThreadStackSize
2000 0
szetszwo         782   0.0  0.5  1242524  86008 s010  S     3:00PM   0:04.07 -d32 TestThreadStackSize
2000 131072
szetszwo         786  14.4  0.5  1123740  85980 s010  S     3:00PM   0:03.95 -d32 TestThreadStackSize
2000 16384
{noformat}
Tested the thread stack size parameters, it does reduce VSZ usage but does not change RSS.
                
> Configurable DataXceiver thread stack size
> ------------------------------------------
>
>                 Key: HDFS-4814
>                 URL: https://issues.apache.org/jira/browse/HDFS-4814
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: datanode
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: h4814_20130510.patch
>
>
> By default, Java creates a thread with 512kB stack size.  In Datanode, we may have 4096
or more DataXceiver threads.  These threads do not require such large stack size and unnecessarily
occupy a large amount of memory.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message