hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Kelly (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms
Date Thu, 03 Mar 2011 17:31:36 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ivan Kelly updated HDFS-1580:
-----------------------------

    Attachment: HDFS-1580+1521.diff
                HDFS-1580.diff

Initial work on 1580. This work is on top of 1521. One of the patches includes that, so it
will apply on top of trunk. The other requires that 1521 has already been applied.

TestEditLog is passing. I haven't tried any other tests yet. Most should pass, but anything
related to backupnode and secondary will fail for the moment. This is because of a change
I've made to construction to FSImage. I've cleaned this up and made setStorageDirectories
private in NNStorage. This means that if the storage directories are not read from the configuration
file, they must be specified on creation of FSImage. This makes it easier for FSEditLog to
know when it can operate on NNStorage and when it cannot. Before it had to wait until someone
called setStorageDirectories before doing anything. Very side-effecty. Not FSEditLog knows
that if storage exists the storagedirectories have been set. This also allows nicer open close
semantics on FSEditLog.

I plan to move this functionallity into a sub jira as it's nicely separate from the journalling
mechanism.

> Add interface for generic Write Ahead Logging mechanisms
> --------------------------------------------------------
>
>                 Key: HDFS-1580
>                 URL: https://issues.apache.org/jira/browse/HDFS-1580
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Ivan Kelly
>         Attachments: HDFS-1580+1521.diff, HDFS-1580.diff, generic_wal_iface.pdf, generic_wal_iface.pdf,
generic_wal_iface.txt
>
>


-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message