hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker
Date Tue, 06 Dec 2016 01:35:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15723974#comment-15723974
] 

Andrew Wang commented on HDFS-8411:
-----------------------------------

Thanks for working on this Sammi and Rakesh for reviewing, I had a few additional comments/questions:

* In StripedReader, bytesRead is incremented when the future is submitted. However, we don't
know if the future has succeeded until later on. Seems like we should increment only for successful
requests?
* Why don't we increment the metrics directly in StripedReader / StripedWriter rather than
doing it in StripedBlockReconstructor?
* If we aren't going to handle remote vs. local reconstruction targets in this JIRA, could
you file a new JIRA to track this as a follow-on? It's pretty important, especially since
on the destination side, it gets lumped together with other OP_WRITE calls.

> Add bytes count metrics to datanode for ECWorker
> ------------------------------------------------
>
>                 Key: HDFS-8411
>                 URL: https://issues.apache.org/jira/browse/HDFS-8411
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: SammiChen
>         Attachments: HDFS-8411-001.patch, HDFS-8411-002.patch, HDFS-8411-003.patch, HDFS-8411-004.patch,
HDFS-8411-005.patch, HDFS-8411-006.patch, HDFS-8411-007.patch, HDFS-8411-008.patch, HDFS-8411-009.patch
>
>
> This is a sub task of HDFS-7674. It calculates the amount of data that is read from local
or remote to attend decoding work, and also the amount of data that is written to local or
remote datanodes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message