hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-1850) DN should transmit absolute failed volume count rather than increments to the NN
Date Tue, 03 May 2011 01:48:03 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eli Collins updated HDFS-1850:
------------------------------

    Description: 
The API added in HDFS-811 for the DN to report volume failures to the NN is "inc(DN)". However
the given sequence of events will result in the NN forgetting about reported failed volumes:

# DN loses a volume and reports it
# NN restarts
# DN re-registers to the new NN

A more robust interface would be to have the DN report the total number of volume failures
to the NN each heart beat (the same way other volume state is transmitted).

  was:
The API added in HDFS-811 for the DN to report volume failures to the NN is "inc(DN)". However
the given sequence of events will result in the NN forgetting about reported failed volumes:

# DN loses a volume and reports it
# NN restarts
# DN re-registers to the new NN

A more robust interface would be to have the DN report the total number of volume failures
to the NN each heart beat (the same way other volume state is transmitted).

This will likely be an incompatible change since it requires changing the Datanode protocol.


> DN should transmit absolute failed volume count rather than increments to the NN
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-1850
>                 URL: https://issues.apache.org/jira/browse/HDFS-1850
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, name-node
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>             Fix For: 0.22.0
>
>         Attachments: hdfs-1850-1.patch, hdfs-1850-2.patch, hdfs-1850-3.patch, hdfs-1850-4.patch,
hdfs-1850-5.patch, hdfs-1850-6.patch, hdfs-1850-7.patch
>
>
> The API added in HDFS-811 for the DN to report volume failures to the NN is "inc(DN)".
However the given sequence of events will result in the NN forgetting about reported failed
volumes:
> # DN loses a volume and reports it
> # NN restarts
> # DN re-registers to the new NN
> A more robust interface would be to have the DN report the total number of volume failures
to the NN each heart beat (the same way other volume state is transmitted).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message