hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-11886) Ozone : improving error handling for putkey operation
Date Thu, 25 May 2017 22:56:04 GMT
Chen Liang created HDFS-11886:

             Summary: Ozone : improving error handling for putkey operation
                 Key: HDFS-11886
                 URL: https://issues.apache.org/jira/browse/HDFS-11886
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ozone
            Reporter: Chen Liang

Ozone's putKey operations involve a couple steps:
1. KSM calls allocateBlock to SCM, writes this info to KSM's local metastore
2. allocatedBlock gets returned to client, client checks to see if container needs to be created
on datanode, if yes, create the container
3. writes the data to container.

it is possible that 1 succeeded, but 2 or 3 failed, in this case there will be an entry in
KSM's local metastore, but the key is actually nowhere to be found. We need to revert 1 is
2 or 3 failed in this case. This can be done with a deleteKey() call to KSM.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

View raw message