hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs
Date Fri, 02 Apr 2010 01:58:27 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852661#action_12852661
] 

Sanjay Radia commented on HDFS-1073:
------------------------------------

Todd, Just looked at your idea. Great minds think alike. :- ) (I am sure that most databases
probably use something similar because it is a fairly obvious solution.)
When the backup NN work was done last year,  I had proposed roughly that scheme - ie numbering
the file incrementally. Rob Chanselor in our team proposed the improvement to use the transaction
id. It decouples the split (ie roll) of the edit log and the checkpoint of the image. 

At that time we didn't do it for lack of time. I think we should do this for the next release
(ie 22 ). It will simplify the code significantly and also avoid tricky bugs. 

> Simpler model for Namenode's fs Image and edit Logs 
> ----------------------------------------------------
>
>                 Key: HDFS-1073
>                 URL: https://issues.apache.org/jira/browse/HDFS-1073
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Sanjay Radia
>
> The naming and handling of  NN's fsImage and edit logs can be significantly improved
resulting simpler and more robust code.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message