hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rushabh S Shah (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-6965) NN continues to issue block locations for DNs with full disks
Date Thu, 11 Sep 2014 16:01:34 GMT

     [ https://issues.apache.org/jira/browse/HDFS-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rushabh S Shah updated HDFS-6965:
---------------------------------
    Attachment: HDFS-6965.patch

Attaching  a patch with the changes mentioned in comments by Daryn and Kihwal.
Added a test case to demonstrate the change.

> NN continues to issue block locations for DNs with full disks
> -------------------------------------------------------------
>
>                 Key: HDFS-6965
>                 URL: https://issues.apache.org/jira/browse/HDFS-6965
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 2.0.0-alpha, 3.0.0
>            Reporter: Daryn Sharp
>            Assignee: chang li
>         Attachments: HDFS-6965.patch
>
>
> Encountered issues where DNs have less space than a full block and reject incoming transfers.
 The NN continues giving out locations for these nodes for some period of time.  It does not
appear to be related to the DN's cached disk usage.
> One impact is required replications are delayed when a full DN is chosen for the pipeline.
 A DN cannot report a broken pipeline so the replication must timeout (5m) before new targets
are chosen.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message