hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Kelly (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1489) breaking the dependency between FSEditLog and FSImage
Date Sun, 19 Dec 2010 17:50:03 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12973027#action_12973027
] 

Ivan Kelly commented on HDFS-1489:
----------------------------------

@Todd

I'll try to have a look this week at possibly splitting it into smaller patches, but I'm not
sure how possible it is given the interconnection between FSImage, FSEditLog & FSNamesystem.
Perhaps NNStorage could be submitted as a separate patch. At least that would get rid of the
majority of the dependencies from FSEditLog to FSImage, and we could work from there. 

The comment about reverting conflicting changes worries me. Which changes in particular are
you referring to? 

> breaking the dependency between FSEditLog and FSImage
> -----------------------------------------------------
>
>                 Key: HDFS-1489
>                 URL: https://issues.apache.org/jira/browse/HDFS-1489
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>    Affects Versions: 0.21.0
>            Reporter: Diego Marron
>         Attachments: HDFS-1489.diff, HDFS-1489.diff, HDFS-1489.pdf
>
>
> This is a refactor patch which its main concerns are:
> - breaking the dependency between FSEditLog and FSImage
> - Splitting the abstracting the error handling and directory management, 
> - Decoupling Storage from FSImage.
> In order to accomplish the above goal, we will need to introduce new classes:
> -  NNStorage: Will care about the storage. It extends Storage class, and will contain
the StorageDirectories.
> -  NNUtils: Some utility static methods on FSImage and FSEditLog will be moved here.
> -  PersistenceManager: FSNameSystem will now be responsible for managing the FSImage
& FSEditLog objects. There will be some logic that will have to moved out of FSImage to
facilite this. For this we propose a PersistanceManager? object as follows.
> For more deep details, see the design document uploaded.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message