hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-2223) Untangle depencencies between NN components
Date Thu, 04 Aug 2011 00:53:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Todd Lipcon updated HDFS-2223:

    Attachment: hdfs-2223-1.txt

Here's a patch which does the following:
- FSImage no longer has a reference to FSNamesystem. Instead, the FSNamesystem is passed in
as a parameter to save/load.
- FSDirectory no longer is responsible for creating FSImage, and no longer goes through FSImage
to get FSNamesystem. I wasn't able to completely remove the {{fsImage}} member in FSDirectory
yet, but that's the next logical step.
- FSDirectory no longer coordinates the loading of the image at startup. This code is in a
new static method {{FSNamesystem.loadFromDisk}} which makes a little more sense
- Removed some constructors from FSNamesystem that were made extraneous by the above work

The tests I've run so far seem to be passing.

> Untangle depencencies between NN components
> -------------------------------------------
>                 Key: HDFS-2223
>                 URL: https://issues.apache.org/jira/browse/HDFS-2223
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hdfs-2223-1.txt
> Working in the NN a lot for HA (HDFS-1623) I've come across a number of situations where
the tangled dependencies between NN components has been problematic for adding new features
and for testability. It would be good to untangle some of these and clarify what the distinction
is between the different components: NameNode, FSNamesystem, FSDirectory, FSImage, NNStorage,
and FSEditLog

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message