hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lei (Eddy) Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7035) Make adding a new data directory to the DataNode an atomic operation and improve error handling
Date Wed, 27 Jan 2016 01:34:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118434#comment-15118434
] 

Lei (Eddy) Xu commented on HDFS-7035:
-------------------------------------

Hi, [~arpitagarwal] 

Currently, we do not enable {{ReconfigureServlet}} to call {{reconfigureProperty}}, in DN.

The reason that it only stores effective volumes, is if there is an disk error in the how
swap process, we would like the admin to replace the disks and directly run reconfig again.


If it is a concern in HDFS-9330, can we suggest {{reconfigurePropertyImpl()}} to return a
value that is stored in conf eventually?

Thanks.



> Make adding a new data directory to the DataNode an atomic operation and improve error
handling
> -----------------------------------------------------------------------------------------------
>
>                 Key: HDFS-7035
>                 URL: https://issues.apache.org/jira/browse/HDFS-7035
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: datanode
>    Affects Versions: 2.5.0
>            Reporter: Lei (Eddy) Xu
>            Assignee: Lei (Eddy) Xu
>              Labels: 2.6.1-candidate
>             Fix For: 2.7.0, 2.6.1
>
>         Attachments: HDFS-7035.000.combo.patch, HDFS-7035.000.patch, HDFS-7035.001.combo.patch,
HDFS-7035.001.patch, HDFS-7035.002.patch, HDFS-7035.003.patch, HDFS-7035.003.patch, HDFS-7035.004.patch,
HDFS-7035.005.patch, HDFS-7035.007.patch, HDFS-7035.008.patch, HDFS-7035.009.patch, HDFS-7035.010.patch,
HDFS-7035.010.patch, HDFS-7035.011.patch, HDFS-7035.012.patch, HDFS-7035.013.patch, HDFS-7035.014.patch,
HDFS-7035.015.patch, HDFS-7035.016.patch
>
>
> It refactors {{DataStorage}} and {{BlockPoolSliceStorage}} to reduce the duplicate code
and supports atomic adding volume operations. Also it parallels loading data volume operation:
each thread loads one volume.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message