hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2018) Move all journal stream management code into one place
Date Thu, 07 Jul 2011 21:38:16 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13061608#comment-13061608
] 

Todd Lipcon commented on HDFS-2018:
-----------------------------------

bq. If you are 2 weeks away from merging 1073 into trunk 

As soon as the currently patch-available issues, I should be ready to merge. So I think closer
to 1 week. If we commit this patch as is, those other patch-available issues will need to
be redone. Or, if we commit those first, this patch will need to be redone. So, I think this
patch could delay the merge by another 2-3 weeks (I'm on vacation all of next week which also
impacts timing, unfortunately)

I was thinking the "dual merge" strategy would satisfy both objectives. The first merge (without
this patch) would get more people running/testing the new 1073 code and enable us to start
a branch for NN HA. Then we finish this work and do a second merge when it's ready.

If you think it's an absolute requirement, I will try to rebase this patch on top of the other
patch-available issues, but it probably won't be ready til 7/18 or so.

> Move all journal stream management code into one place
> ------------------------------------------------------
>
>                 Key: HDFS-2018
>                 URL: https://issues.apache.org/jira/browse/HDFS-2018
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ivan Kelly
>            Assignee: Ivan Kelly
>             Fix For: Edit log branch (HDFS-1073)
>
>         Attachments: HDFS-2018.diff, HDFS-2018.diff, HDFS-2018.diff, HDFS-2018.diff,
HDFS-2018.diff, HDFS-2018.diff, HDFS-2018.diff, HDFS-2018.diff, HDFS-2018.diff
>
>
> Currently in the HDFS-1073 branch, the code for creating output streams is in FileJournalManager
and the code for input streams is in the inspectors. This change does a number of things.
>   - Input and Output streams are now created by the JournalManager.
>   - FSImageStorageInspectors now deals with URIs when referring to edit logs
>   - Recovery of inprogress logs is performed by counting the number of transactions instead
of looking at the length of the file.
> The patch for this applies on top of the HDFS-1073 branch + HDFS-2003 patch.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message