hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hrishikesh Gadre (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13926) ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads
Date Tue, 09 Oct 2018 22:24:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644167#comment-16644167
] 

Hrishikesh Gadre commented on HDFS-13926:
-----------------------------------------

[~xiaochen] please find the attached patch for branch-3.0. Note that since  HDFS-13468 and HADOOP-15507
are not available in branch-3.0, I removed the logic to populate ecBytesRead metric. Please
take a look and let me know your feedback.

> ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads
> -----------------------------------------------------------------------------------
>
>                 Key: HDFS-13926
>                 URL: https://issues.apache.org/jira/browse/HDFS-13926
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: erasure-coding
>    Affects Versions: 3.0.0
>            Reporter: Xiao Chen
>            Assignee: Hrishikesh Gadre
>            Priority: Major
>             Fix For: 3.2.0
>
>         Attachments: HDFS-13926-002.patch, HDFS-13926-003.patch, HDFS-13926-branch-3.0-001.patch,
HDFS-13926.01.patch, HDFS-13926.prelim.patch
>
>
> During some integration testing, [~nsheth] found out that per-thread read stats for EC
is incorrect. This is due to the striped reads are done asynchronously on the worker threads.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message