hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11154) Block Storage : store server state to persistent storage
Date Mon, 21 Nov 2016 20:18:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684607#comment-15684607
] 

Anu Engineer commented on HDFS-11154:
-------------------------------------

Thank you for implementing this feature. It looks quite good overall.  Some minor comments.

1. Wondering if we need a lock in CBlockManager.java between the calls.

2. For function testSame, did you want to implement a Comparable interface ? 

3. Why are we copying the levelDB store class ? Can we move this to a place where both Ozone
and Cblock can use it instead of having 2 copies of the same class ? 

> Block Storage : store server state to persistent storage
> --------------------------------------------------------
>
>                 Key: HDFS-11154
>                 URL: https://issues.apache.org/jira/browse/HDFS-11154
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>         Attachments: HDFS-11154-HDFS-7240.001.patch, HDFS-11154-HDFS-7240.002.patch,
HDFS-11154-HDFS-7240.003.patch
>
>
> Currently, all the storage state are kept in server memory. If server crashes, we would
lose all the volume information. This JIRA stores server internal state into its local disk.
Such that on server failure, we can simply restart server and restore volume information from
disk.
> More specifically, the internal state written to disk is mainly the mapping from volume
to its underlying containers, plus some meta information such as volume size, block size,
etc.
> Note that this is only a simple, minimum set mechanism for persistence. It is more like
a counterpart of fsimage in HDFS, but without edit logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message