hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-4892) Number of transceivers reported by the datanode is incorrect
Date Thu, 06 Jun 2013 21:50:21 GMT

     [ https://issues.apache.org/jira/browse/HDFS-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Suresh Srinivas updated HDFS-4892:
----------------------------------

    Description: 
Currently a datanode reports the transceiver count to namenode. Namenode aggregates this as
TotalLoad metrics and is used for monitoring cluster activity. It is also used for making
block placement decision, to qualify if a datanode is a good target.

Currently transceiver count is = 1 (for XceiverServer) + 1 * (number of readers) + 2 * (Number
of writers in pipeline) + 1 * (number of datanode replications) + 1 * (number of recover blocks)

Should the number of transceiver just reflect number of readers + writers, instead of reporting
it as is currently done? We should perhaps report readers and writers as separate count (I
will file a separate jira for this).

  was:
Currently a datanode reports the transceiver count to namenode. Namenode aggregates this as
TotalLoad metrics and is used for monitoring cluster activity. It is also used for making
block placement decision, to qualify if a datanode is a good target.

Currently transceiver count is = 1 (for XceiverServer) + 1 * (number of readers) + 2 * (Number
of writers in pipeline) + 1 * (number of datanode replications) + 1 * (number of recover blocks)

Should the number of transceiver just reflect number of readers + writers, instead of reporting
it as is currently done. Separately we should perhaps report readers and writers as separate
count.

    
> Number of transceivers reported by the datanode is incorrect
> ------------------------------------------------------------
>
>                 Key: HDFS-4892
>                 URL: https://issues.apache.org/jira/browse/HDFS-4892
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.0.0-alpha
>            Reporter: Suresh Srinivas
>
> Currently a datanode reports the transceiver count to namenode. Namenode aggregates this
as TotalLoad metrics and is used for monitoring cluster activity. It is also used for making
block placement decision, to qualify if a datanode is a good target.
> Currently transceiver count is = 1 (for XceiverServer) + 1 * (number of readers) + 2
* (Number of writers in pipeline) + 1 * (number of datanode replications) + 1 * (number of
recover blocks)
> Should the number of transceiver just reflect number of readers + writers, instead of
reporting it as is currently done? We should perhaps report readers and writers as separate
count (I will file a separate jira for this).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message