hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4782) backport edit log corruption toleration to branch-1-win
Date Wed, 01 May 2013 01:01:26 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13646253#comment-13646253
] 

Tsz Wo (Nicholas), SZE commented on HDFS-4782:
----------------------------------------------

For backporting, let's try to make the code to be the same in both branches.  Then, it would
be easier to maintain.
- add FSEditLog.PositionTrackingInputStream instead of org.apache.hadoop.io.PositionInputStream,
although I like the latter more.
- In FSEditLog.loadFSEdits(..),
-* initialize PositionTrackingInputStream even if isTolerationEnabled is false.  It is useful
for printing log messages.
-* catch Throwable instead of Exception.  Then, it will catch Error(s) like OutOfMemoryError.
 (If an edit log is corrupted, the code may try to create a huge array, so OutOfMemoryError
is possible.)
- use the class name Padding instead of PaddingCorruption in TestEditLogToleration.

                
> backport edit log corruption toleration to branch-1-win
> -------------------------------------------------------
>
>                 Key: HDFS-4782
>                 URL: https://issues.apache.org/jira/browse/HDFS-4782
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 1-win
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: HDFS-4782-branch-1-win.1.patch
>
>
> HDFS-3521 made changes to management of the edits log to prevent certain cases of corruption.
 This issue tracks backporting those changes to branch-1-win.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message