hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8150) Make getFileChecksum fail for blocks under construction
Date Wed, 15 Apr 2015 16:03:58 GMT
Kihwal Lee created HDFS-8150:

             Summary: Make getFileChecksum fail for blocks under construction
                 Key: HDFS-8150
                 URL: https://issues.apache.org/jira/browse/HDFS-8150
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Kihwal Lee
            Priority: Critical

We have seen the cases of validating data copy using checksum then the content of target changing.
It turns out the target wasn't closed successfully, so it was still under-construction.  One
hour later, a lease recovery kicked in and truncated the block.

Although this can be prevented in many ways, if there is no valid use case for getting file
checksum from under-construction blocks, can it be disabled?  E.g. Datanode can throw an exception
if the replica is not in the finalized state.

This message was sent by Atlassian JIRA

View raw message