hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10195) Ozone: Add container persistence
Date Thu, 24 Mar 2016 17:48:25 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210632#comment-15210632

Jing Zhao commented on HDFS-10195:

Thanks a lot for the detailed comments and explanation, [~anu]! 

bq. so ideally we should be having a DB per pipeline

For a container's metadata db replication, I think it may be better to replicate the log/ops
instead of replicating the db itself. Looks to me this can avoid the too many db issue, and
also support metadata update ops better. We may need to have a separate metadata related log
file for each container in this case (which may still have some advantage compared with writing
individual leveldb logs/files I guess).

For this jira I think we do not need to make any change to the current db design/impl. If
you think it's worth further exploration and discussion, we can use a separate jira.

> Ozone: Add container persistence
> --------------------------------
>                 Key: HDFS-10195
>                 URL: https://issues.apache.org/jira/browse/HDFS-10195
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Anu Engineer
>            Assignee: Anu Engineer
>             Fix For: HDFS-7240
>         Attachments: HDFS-10195-HDFS-7240.001.patch
> Adds file based persistence for containers.

This message was sent by Atlassian JIRA

View raw message