hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-1850) DN should transmit absolute failed volume count rather than increments to the NN
Date Tue, 26 Apr 2011 02:33:46 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Eli Collins updated HDFS-1850:

    Attachment: hdfs-1850-1.patch

Patch attached.

1. Modifies FSDataset to track and report volume failures like other capacity etc. Adds the
test listed in the description, makes TestDataNodeVolumeFailureReporting more robust.

2. Renames the volumesFailed metric to volumeFailures to accurately reflect what it's tracking.
This doesn't break compatibility because this metric (added in HDFS-811) has not yet been

> DN should transmit absolute failed volume count rather than increments to the NN
> --------------------------------------------------------------------------------
>                 Key: HDFS-1850
>                 URL: https://issues.apache.org/jira/browse/HDFS-1850
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, name-node
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>             Fix For: 0.23.0
>         Attachments: hdfs-1850-1.patch
> The API added in HDFS-811 for the DN to report volume failures to the NN is "inc(DN)".
However the given sequence of events will result in the NN forgetting about reported failed
> # DN loses a volume and reports it
> # NN restarts
> # DN re-registers to the new NN
> A more robust interface would be to have the DN report the total number of volume failures
to the NN each heart beat (the same way other volume state is transmitted).
> This will likely be an incompatible change since it requires changing the Datanode protocol.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message