hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaobing Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11558) BPServiceActor thread name is too long
Date Mon, 03 Apr 2017 18:32:41 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953963#comment-15953963
] 

Xiaobing Zhou commented on HDFS-11558:
--------------------------------------

v5 removed the constructor BPOfferService.
nameserviceId can be null for unit tests when cluster is booting when ns is not configured,
in other words, nsToAdd will be null in BlockPoolManager#doRefreshNamenodes.

The stack trace where getNameserviceId is called.
{noformat}
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.getNameserviceId(BPOfferService.java:183)
	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.formatThreadName(BPServiceActor.java:557)
	at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.start(BPServiceActor.java:544)
	at org.apache.hadoop.hdfs.server.datanode.BPOfferService.start(BPOfferService.java:301)
	at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager$1.run(BlockPoolManager.java:129)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1965)
	at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.startAll(BlockPoolManager.java:124)
	at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.doRefreshNamenodes(BlockPoolManager.java:219)
	at org.apache.hadoop.hdfs.server.datanode.BlockPoolManager.refreshNamenodes(BlockPoolManager.java:158)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1423)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:495)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2735)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2638)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1621)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:868)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:491)
	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:450)
{noformat}

> BPServiceActor thread name is too long
> --------------------------------------
>
>                 Key: HDFS-11558
>                 URL: https://issues.apache.org/jira/browse/HDFS-11558
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Xiaobing Zhou
>            Priority: Minor
>         Attachments: HDFS-11558.000.patch, HDFS-11558.001.patch, HDFS-11558.002.patch,
HDFS-11558.003.patch, HDFS-11558.004.patch, HDFS-11558.005.patch
>
>
> Currently, the thread name looks like
> {code}
> 2017-03-20 18:32:22,022 [DataNode: [[[DISK]file:/Users/szetszwo/hadoop/t2/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/dn1_data0,
[DISK]file:/Users/szetszwo/hadoop/t2/hadoop-hdfs-project/hadoop-hdfs/target/test/data/dfs/data/dn1_data1]]
 heartbeating to localhost/127.0.0.1:51772] INFO  ...
> {code}
> which contains the full path for each storage dir.  It is unnecessarily long.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message