hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "SammiChen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage
Date Mon, 16 Jan 2017 11:25:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

SammiChen updated HDFS-11268:
-----------------------------
    Description: Currently, FSImageFormatProtoBuf has the information about whether the file
is striped or not and saved file's erasure coding policy ID in replication field. But later,
when FSImage is loaded to create the name space, the default system erasure coding policy
is used to reconstruct file's block structure.  In case if the erasure coding policy of file
is not the default erasure coding policy, the content of the file cannot be accessed correctly.
  (was: Currently, FSImage only has the information about whether the file is striped or not.
It doesn't save the erasure coding policy ID. Later, when the FSImage is loaded to create
the name space, the default system ec policy is used to as file's ec policy.  In case if the
ec policy on file is not the default ec policy, then the content of the file cannot be accessed
correctly in this case. )

> Correctly reconstruct erasure coding file from FSImage
> ------------------------------------------------------
>
>                 Key: HDFS-11268
>                 URL: https://issues.apache.org/jira/browse/HDFS-11268
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha1
>            Reporter: SammiChen
>            Assignee: SammiChen
>            Priority: Critical
>              Labels: hdfs-ec-3.0-must-do
>
> Currently, FSImageFormatProtoBuf has the information about whether the file is striped
or not and saved file's erasure coding policy ID in replication field. But later, when FSImage
is loaded to create the name space, the default system erasure coding policy is used to reconstruct
file's block structure.  In case if the erasure coding policy of file is not the default erasure
coding policy, the content of the file cannot be accessed correctly. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message