hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11274) Datanode should only check the failed volume upon IO errors
Date Wed, 28 Dec 2016 05:45:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782123#comment-15782123
] 

Arpit Agarwal commented on HDFS-11274:
--------------------------------------

The potential shutdown issue in saveDfsUsed is a nice find and fix!

Regarding the new return value of AsyncChecker#schedule (also a nice find) - what do you think
of just returning either a null or {{Optional<ListenableFuture<...>>}} if no disk
check was scheduled? Otherwise, a couple of comments:
# The ThrottledAsyncChecker#ScheduleResult class can be static.
# There are a couple of unchecked assignments in ThrottledAsyncChecker#schedule (lines 110,
120 and 135).

> Datanode should only check the failed volume upon IO errors 
> ------------------------------------------------------------
>
>                 Key: HDFS-11274
>                 URL: https://issues.apache.org/jira/browse/HDFS-11274
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HDFS-11274.01.patch, HDFS-11274.02.patch, HDFS-11274.03.patch, HDFS-11274.04.patch
>
>
> This is a performance improvement that is possible after HDFS-11182. The goal is to trigger
async volume check with throttling only on suspected volume upon datanode file IO errors.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message