hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker
Date Tue, 20 Dec 2016 03:28:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763092#comment-15763092
] 

ASF GitHub Bot commented on HDFS-11182:
---------------------------------------

Github user xiaoyuyao commented on a diff in the pull request:

    https://github.com/apache/hadoop/pull/168#discussion_r93166078
  
    --- Diff: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
---
    @@ -3208,68 +3200,49 @@ public ShortCircuitRegistry getShortCircuitRegistry() {
       }
     
       /**
    -   * Check the disk error
    +   * Check the disk error synchronously.
        */
    -  private void checkDiskError() {
    -    Set<StorageLocation> unhealthyLocations = data.checkDataDir();
    -    if (unhealthyLocations != null && !unhealthyLocations.isEmpty()) {
    +  @VisibleForTesting
    +  public void checkDiskError() throws IOException {
    +    Set<FsVolumeSpi> unhealthyVolumes;
    +    try {
    +      unhealthyVolumes = volumeChecker.checkAllVolumes(data);
    +      LOG.info("checkDiskError got {} failed volumes - {}",
    +          unhealthyVolumes.size(), unhealthyVolumes);
    +      lastDiskErrorCheck = Time.monotonicNow();
    --- End diff --
    
    should this be timer.monotonicNow();


> Update DataNode to use DatasetVolumeChecker
> -------------------------------------------
>
>                 Key: HDFS-11182
>                 URL: https://issues.apache.org/jira/browse/HDFS-11182
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
>
> Update DataNode to use the DatasetVolumeChecker class introduced in HDFS-11149 to parallelize
disk checks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message