hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lukas Majercak (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-14043) Tolerate corrupted seen_txid file
Date Thu, 01 Nov 2018 19:39:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-14043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672077#comment-16672077

Lukas Majercak edited comment on HDFS-14043 at 11/1/18 7:38 PM:

[~cmccabe] could you review this, as this seems to be related to HDFS-3004.

was (Author: lukmajercak):
[~cmccabe] could you review this, as this seems to be related to https://issues.apache.org/jira/browse/HDFS-3004

> Tolerate corrupted seen_txid file
> ---------------------------------
>                 Key: HDFS-14043
>                 URL: https://issues.apache.org/jira/browse/HDFS-14043
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs, namenode
>    Affects Versions: 2.9.2, 3.1.2, 2.9.3
>            Reporter: Lukas Majercak
>            Assignee: Lukas Majercak
>            Priority: Major
>         Attachments: HDFS-14043.001.patch
> We already tolerate IOExceptions when reading seen_txid file from namenode's dirs. So
we take the maximum txid of all the *readable* namenode dirs. We should extend this to when
the file is corrupted. Currently, PersistentLongFile.readFile throws NumberFormatException
in this case and the whole NN crashes.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message