hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinayakumar B (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes
Date Tue, 02 May 2017 07:00:15 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Vinayakumar B updated HDFS-10614:
    Attachment: HDFS-10614.03.patch

Updated the patch.
Added genstamp check before removing the storage.
Thanks [~jingzhao] for good suggestion.
Apologies for delayed updated on patch.

> Appended blocks can be closed even before IBRs from DataNodes
> -------------------------------------------------------------
>                 Key: HDFS-10614
>                 URL: https://issues.apache.org/jira/browse/HDFS-10614
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Vinayakumar B
>            Assignee: Vinayakumar B
>         Attachments: HDFS-10614.01.patch, HDFS-10614.02.patch, HDFS-10614.03.patch
> Scenario:
>    1. Open the file for append()
>    2. Trigger append pipeline setup by adding some data.
>    3. Consider RECEIVING IBRs of DNs reaches NN first.
>    4. updatePipeline() rpc sent to namenode to update the pipeline.
>    5. Now, if complete() is called on the file even before closing the pipeline, then
block will be COMPLETE, even before block is actually FINALIZED at DN side and file will be

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message